Methods and apparatus for manipulating and providing facsimile transmissions to electronic storage destinations

ABSTRACT

A method for a computer system for transmitting a facsimile to an electronic destination, includes receiving the facsimile comprising an instruction page with an optical representation of the electronic destination address and an optical representation of a user selection of an option, and a document encoded in a fax format, determining the electronic destination address from the optical representation of the electronic destination address, wherein the electronic destination address need not be known to the computer system before receiving the facsimile, determining the one selected option in response to the optical representation of the user selection of the option, determining a modified document in response to the document and in response to the one selected option, encoding the modified document into a second transmission format, and transmitting the modified document and additional service provider data encoded in the second transmission format to the electronic destination address.

CROSS-REFERENCE TO RELATED APPLICATIONS

The present application is a Nonprovisional Application of U.S.Provisional Patent Application Ser. No. 60/889,470 filed on Feb. 12,2007 and claims priority to and is a continuation-in-part application ofU.S. patent application Ser. Nos. 11/357,920 filed on Feb. 16, 2006,11/357,360 filed on Feb. 16, 2006, and 11/357,739 filed on Feb. 16,2006, which are Nonprovisional applications of U.S. Patent ApplicationSer. Nos. 60/654,244 filed on Feb. 17, 2005 and 60/756,749 filed on Jan.6, 2006, and are continuations-in-part application of U.S. patentapplication Ser. No. 10/160,445 filed on May 28, 2002, now U.S. Pat. No.7,079,275, which is a continuation-in-part of U.S. patent applicationSer. No. 10/155,808 filed on May 24, 2002, now U.S. Pat. No. 7,164,488,which is a continuation of U.S. patent application Ser. No. 09/537,820filed on Mar. 28, 2000, now U.S. Pat. No. 6,424,426. These disclosuresare hereby incorporated by reference in their entirety for all purposes.

BACKGROUND OF THE INVENTION

The present invention relates to methods and apparatus for transferringdigitized representations of documents via selected computer networktransfer protocols. More particularly, some embodiments of the presentinvention provides for, receiving a digitized image representing adocument (including text, images, or the like), converting the digitizedrepresentation from a first file format into a second file format, andoutputting the second file to an appropriate destination based upon dataderived from the digitized representation of the document, via a desiredcomputer network transfer protocol.

In the past, fax images can be moved over the Internet by converting faxsignals having a fax format to an email format (e.g. RFC-822). Once theconversion is completed, the email is then transferred over the Internetto the intended destination according to the Simple Mail TransferProtocol (SMTP) or similar protocol. The Internet is the worldwidenetwork of networks based on the TCP/IP (Transmission ControlProtocol/Protocol). Currently, there are various subscriber basedservice that permit a subscriber to send fax images over the Internet.

According to one type of service, offered or previously offered bycompanies such as eFax, Jfax, a subscriber is provided with a uniquetelephone number. Any documents faxed to that number are converted toemail format and transferred to the subscriber's email inbox. Onedrawback of this type of service is that it requires the subscriber tohave a specific telephone number associated with their email address. Asecond drawback is that the subscriber must distribute the personal faxtelephone number to any persons who would potentially want to send a faxto the subscriber. Finally, this type of service is expensive to operatefrom the service provider's perspective since the costs associated withbuying and operating so many individual and dedicated phone numbers isvery high.

Another type of service previously provided by UUNET (now WorldCom),requires a subscriber to attach additional hardware between thesubscriber's fax machine and the service's network. The purpose of thisservice is to reduce long distance faxing costs for high volume users.The UUNET system converts a fax to the equivalent of an email and thenroutes the email over UUNET's network to the nearest UUFAX server. TheUUFAX server converts the email back to fax format and transmits the faxusing a local call to the fax machine at the destination. A drawback ofthis type of service is that it takes time and up-front hardwareadditions and expenditures to have access to the service.

Other types of client hardware solutions include products from RightFAXand HP Scanners. Drawbacks to these solutions are that a user mustinvest in expensive hardware.

Hence, it would be desirable to provide a method and system that iscapable of efficiently transferring digitized documents throughappropriate network protocols to desired destinations.

SUMMARY OF THE INVENTION

The present invention relates to methods and apparatus for automaticallytransferring digitized representations of documents via specifiedcomputer network protocols to electronic data destinations. Moreparticularly, some embodiments of the present invention provide forreceiving optically digitized representations of documents (e.g. text,images, etc.) Various methods are contemplated, including receiving afacsimile transmission via a facsimile machine (e.g. a stand alonemachine, a computer); receiving digitized data from a scanner ormultifunction copier/scanner; receiving digitized data from a digitalcamera (e.g. camera phone, PDA, digital camera, digital video camera);receiving a “print-to-file” file; or the like.

In various embodiments, the digitized data may be automaticallyconverted from one data storage format to another storage format priorto transmission to the electronic data destinations. For example,facsimile transmissions may be converted into a widely-used file format,such as .pdf, .tiff, .doc, .txt, or the like; a scanned .tiff image maybe converted into another graphics file format, such as .jpg, .bmp,.pdf, .gif; or the like. In various embodiments, the electronic datadestination for the digitized data may be a web server, an e-mail server(e-mail box), a storage directory, a database, a storage network, an FTPlocation, a web server, a directory location, or the like. Further, invarious embodiments, the data format may be a format appropriate forsubsequent retrieval by a receiver via a number of different ways, suchas via an e-mail client, via a web browser, via a web client, via adatabase management system, via a specified directory, or the like. Insome embodiments of the present invention, various computer networkprotocols may be used to transfer the data to the intended destinations,such as HTTPS, FTP, HTTP, SMTP, WAP, or the like.

In the discussion bellow, some embodiments refer to a fax template orcover page, a fax machine, and a fax transmission. It should beunderstood that the fax template page is merely one embodiment of acover page for a digitized representation of a document.

Additionally, other apparatus for creating such a digitized templatepage include an optical scanner, a multi-function machine (e.g.copier/scanner), a digital camera, a computer or the like. Additionally,other transmission methods other than a fax to e-mail transmission arecontemplated, such as a transmission using computer network protocols,using infrared or optical link, using a Bluetooth or other wirelesslink, and the like.

Embodiments of the Secure Document Transformation Architecture areengineered for scalability, security, privacy, reliability andcompatibility. Various embodiments include a scalable architectureincluding:

1. Alternate-Path Telco Circuits used to provide call failover in caseof fiber outages. Embodiments of the present invention (for example,implemented by MongoNet) utilize super-trunks pairs of T1 circuits, thatprovide both carrier and physical loop diversity thereby reducing theprobability of an external service outage (i.e. a backhoe cuttingfiber).

2. Multiple Data Centers used to co-locate Services with geographicdiversity.

3. Clusters used to bring high-availability to embodiments of thepresent invention (MongoNet Services). Various embodiments are deployedon RedHat AS 2.1 (Advanced Server) with a SAN backend.

4. Distributed, Threaded, Message-based Architecture used to provideback-bone for embodiments of the present invention (e.g. MongoNetServices) scalability, failover and fault tolerance.

5. Packages are used to ease the time to production for new servermachines and for new releases of service software to existing machines.

Various embodiments of the present invention provide high-levels ofsecurity by reducing exposure to security exploits by deploying packetfiltering, firewalling, and VLANing coupled with tight ACLs and accessprocedures. No outside or DMZ traffic is allowed into the internalsubnets for any reason except at the initiation of an internal process(i.e. outbound email). For sites supporting the SMTP verb STARTTLS,embodiments are delivered via TLS. As an added layer of security,various embodiments can be delivered to a customer's SMTP server orposted to a customer URL for further handling (for compliance, indexing,and/or archiving). In still other embodiments, secure email applianceservers are also available as a bolt-on option for further customizationwithin the customer's firewall.

Various embodiments provide a high level of privacy, as operation may befully automated. In some embodiments, documents are converted and routedvia character recognition systems, such as described in the parentapplications. Various embodiments of the present invention do not storeany intermediate files, unless instructed to do so by the customer as acustom account option. Under some configurations, all content files aredeleted instantly following the transmission of a transmission sent fromvarious embodiments.

Various embodiments are directed to including “compliance” or“gatekeeper” features that allow a customer to view and approve allfaxes or transmission before they are sent. Various secure embodimentssend a link to the fax recipient, or the like, (minus the PDFattachment) and requests the receiver to login securely to receive thePDF. Such solutions may be used together and may be fully hosted invarious embodiments. In other embodiments, the customer may choose toinstall a Secure Email Appliance Server embodiment as a bolt-on withinthe customer's firewall. Various secure and compliance embodimentsprovide the customer with the highest levels of security possible,eliminating content delivery through email.

Various embodiments of the present invention may maintain multipleinstances of all services. Each request message presented to a serviceshould conform to internal standards and may be presented to anyinstance of a particular service. Message Router response checkingprovides that a response makes sense for the message presented. Variousembodiments may be stateless. Various embodiments use an Oracle databasein a HA (High-Availability) configuration.

Various embodiments utilize a template approach to email construction,or other delivery vehicle construction, thus providing a high degree ofcompatibility with customers' systems. If a site has a specialconstraining (i.e. no HTML mail), embodiments may be configured to meetthe customer's needs. In some embodiments, Adobe® ubiquitous PDF format,freely available at www.adobe.com, are used.

According to an aspect of the invention, methods for a computer systemfor transmitting a facsimile to an electronic destination address aredisclosed. Processes may include receiving the facsimile comprising aninstruction page and a document, wherein the instruction page includesan optical representation of the electronic destination address and anoptical representation of a user selection of one or more options, andwherein the document is encoded in a first transmission format, anddetermining the electronic destination address from the opticalrepresentation of the electronic destination address, wherein theelectronic destination address need not be known to the computer systembefore receiving the facsimile. Techniques may include determining theone or more selected options in response to the optical representationof the user selection of one or more options, determining a modifieddocument in response to the document and in response to the one or moreselected options, and encoding the modified representation of thedocument into a second transmission format. Various methods may includedetermining additional service provider data in response to thefacsimile, and transmitting the additional service provider data and themodified document encoded in the second transmission format to theelectronic destination address.

According to another aspect of the invention, methods for a computersystem for transmitting a facsimile to an electronic destination addressare described. Techniques include receiving the facsimile comprising atransmission cover page and a document, entering a plurality of textentries and at least a marked option on the transmission cover page toform a filled-in transmission cover page, wherein the plurality of textentries includes the electronic destination address, and sending adigitized transmission encoded in a transmission format to atransmission server, wherein the digitized transmission includes thefilled-in transmission cover page and a document. In variousembodiments, a transmission is sent to the electronic destinationaddress and includes service provider data and a modified documentstored in a storage format, and the electronic destination address isoptically derived from the plurality of text entries on the transmissioncover page. In various embodiments, the modified document stored in thestorage format is determined in response to a user-selected option, andin response to the document in the transmission format, theuser-selected option is optically derived from the marked option on thetransmission cover page, and the transmission server need not know theelectronic destination address prior to receiving the digitizedtransmission.

According to another aspect of the present invention, computer systemsfor transmitting a facsimile to an electronic destination address aredisclosed. Apparatus may include a receiving portion configured toreceive the facsimile comprising an instruction page and a document,wherein the instruction page includes an optical representation of theelectronic destination address and an optical representation of a userselection of one or more options, and wherein the document is encoded ina first transmission format, and a detecting portion coupled to thereceiving portion, wherein the detecting portion is configured todetermine the electronic destination address from the opticalrepresentation of the electronic destination address, wherein theelectronic destination address need not be known to the computer systembefore receiving the facsimile. Devices may include a determiningportion coupled to the receiving portion, wherein the determiningportion is configured to determine the one or more selected options inresponse to the optical representation of the user selection of one ormore options, and a modification portion coupled to the receivingportion and to the determining portion, wherein the modification portionis configure to determine a modified document in response to thedocument and in response to the one or more selected options. Systemsmay include an encoding portion coupled to the modification portion,wherein the encoding portion is configured to encode the modifiedrepresentation of the document into a second transmission format; and atransmitter portion coupled to the encoding portion and to the detectingportion, wherein the transmitter portion is configured to transmitadditional service provider data and the modified document encoded inthe second transmission format to the electronic destination address.

According to yet another aspect of the invention, a computer programproduct for a computer system including a processor comprises computerexecutable code resident on a tangible memory. The computer programproduct is configured to direct a computer system to operate accordingto the methods described above. The codes reside on a tangible mediaincluding magnetic media such as floppy disks, hard drives, networkstorage devices and removable hard disks, optical storage media such asCD-ROMS, DVDs, high capacity DVDs, holographic memory, and bar codes,semiconductor memories such as flash memories, read-only-memories(ROMS), and battery-backed volatile memories, and the like.

Reference to the remaining portions of the specification, including thedrawings and claims, will realize other features and advantages ofvarious embodiments of the present invention. Further features andadvantages of various embodiments of the present invention, as well asthe structure and operation of various embodiments of the presentinvention, are described in detail below with respect to accompanyingdrawings. Like reference numbers indicate identical or functionallysimilar elements.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a simplified block diagram of a system according to anexemplary embodiment of the present invention;

FIG. 2 is a simplified block diagram showing a hardware configuration ofa Point of Presence (POP) providing a fax/email interface according toan exemplary embodiment of the present invention;

FIG. 3A is an illustration of a process of obtaining an email coverpage, according to an exemplary embodiment of the present invention;

FIG. 3B is an illustration of a process of a user interacting with thesystem of the present invention to send an email from a fax machine,according to an exemplary embodiment of the present invention;

FIG. 4 is an exemplary illustration of an email cover page received fromthe POP of FIG. 2;

FIG. 5 is a simplified block diagram showing the software architectureof the POP of FIG. 2;

FIG. 6A is an exemplary illustration of a fax-to-email confirmation pagereceived from the POP of FIG. 2;

FIG. 6B is another exemplary illustration of a fax-to-email confirmationpage received from the POP of FIG. 2;

FIG. 7 is a simplified block diagram of a network operations center(NOC);

FIG. 8A is an illustration of a process of a user interacting with thesystem of the present invention to send a fax from an email, accordingto an exemplary embodiment of the present invention;

FIG. 8B is an illustration of a reply process wherein a recipient of thefax, delivered in the process according to FIG. 8A, replies to the faxusing a return fax page;

FIG. 9 is a flow diagram illustrating exemplary operations of a securitymechanism used to protect against unauthorized access of emails inaccordance with an exemplary embodiment of the present invention;

FIG. 10 is a simplified block diagram illustrating an exemplaryapplication in accordance with the present invention;

FIG. 11 is an example of another embodiment of the present invention;

FIG. 12 is an example of another embodiment of the present invention;

FIG. 13 is a block diagram of a flow chart according to an embodiment ofthe present invention;

FIG. 14 is a simplified block diagram illustrating a network dataflowaccording to embodiments of the present invention;

FIG. 15 is a simplified block diagram illustrating a networkarchitecture according to various embodiments of the present invention;and

FIG. 16 is a block diagram of another embodiment according to anembodiment of the present invention.

FIGS. 17A-D are simplified block diagrams illustrating examplesaccording to various embodiments of the present invention; and

FIGS. 18-18B are simplified block diagrams illustrating examplesaccording to various embodiments of the present invention.

DETAILED DESCRIPTION OF THE INVENTION

The present invention in the form of one or more exemplary embodimentswill now be described. FIG. 1 is a high-level block diagram of afacsimile/email communication system 5 according to one embodiment ofthe present invention. System 5 comprises a network operations center(NOC) 8, selectively coupled to both the Plain Old Telephone System(POTS) and the Internet, and a plurality of Points of Presence (POPs) 10selectively coupled to NOC 8 via the POTs and the Internet. The“Internet,” as meant here, means the worldwide network of networks basedon the TCP/IP protocol and all means of access thereto (e.g. a localarea network having an email system and being coupled to the Internet).(TCP/IP stands for “Transmission Control Protocol/Protocol” and is alanguage governing communication between all computers on the Internet.)

As will be explained in detail below, system 5 permits a user to, amongother things, send an e-mail from any standalone fax machine 2 andreceive faxes from a fax or email sender without having to distribute aunique and predefined fax number to the fax or email sender. Here, itshould be emphasized that the fax machine 2, as shown in FIG. 1, is onlya working example. In other words, fax machine as it is used in thecontext of various embodiments of the present invention may alsocomprise any facsimile protocol compliant communication device or anyother scanning device. Similarly, computer workstation 4, in FIG. 1, isonly a working example. In other words any device that is capable ofsending an email may be used instead of computer workstation 4.

POPs 10 are distributed over a wide geographic area, for example, theUnited States or throughout the world. An exemplary embodiment of a POP10 is shown in FIG. 2. POP 10 comprises one or more fax modem banks 20;one or more fax servers 22; an advertisement and statistics (ad/stat)server 24; an email server 26; an interactive voice response (IVR) unit28; an Ethernet switch 30; an IP router 32; and a T-1 channel serviceunit (CSU) 34. It should be emphasized that the embodiment of POP 10 inFIG. 2 is only exemplary. For example, other configurations are withinthe spirit and scope of various embodiments of the present invention,including but not limited to use of higher-capacity Internet accesslines (e.g. T-3), provision for multiple switched email servers, etc.FIGS. 1 and 2 will be described in further detail in the context of thedescription presented below.

Referring now to FIG. 3A, there is shown an illustration of how a userobtains an “email cover page” from a fax server 22, according to anexemplary embodiment of the present invention. At step 40, the userdials a specific toll-free (e.g. 1-800) fax-back number from any faxmachine or telephone. It should be understood that this fax-back numberis not limited to a toll-free telephone number but may include any othertype of telephone number as well. This fax-back number is routed by thetelephone network via the POTS to a POP 10, based on the user'sgeographic locale. As shown in FIG. 2, fax modem bank 20 of POP 10receives the fax over, for example, a B-1 line, which comprises 24-linetelephone bundle. Then, at step 42, POP 10 sends a blank “email coverpage” back to the user with further instructions on how to send an emailfrom the user's fax machine.

The email cover page looks like a normal fax cover sheet, but itcontains lines of blank character boxes and a local telephone number theuser can use so that the fax can be sent without the user having toincur any cost. The local telephone number is generated by a tabledriven translation process through automatic number identification,detectable from outbound 1-800 numbers. In an alternative embodimenteach POP 10 of system 5 would be accessible using a single toll-freenumber. An exemplary email cover page is shown in FIG. 4. In oneembodiment the character boxes 61 have “tick marks” 63 on the edges ofeach character box 61. Tick marks 63 have the effect of coercing theuser to enter characters in the character boxes 61 but away from thecharacter box edges. Characters entered away from the character boxedges is beneficial, since later in the process, when characterrecognition is performed, the characters can be identified moreaccurately.

In one exemplary embodiment, the email cover page, or more generally,the cover page, further includes a list of special features or optionsthat can be selected by a user. For example, one of the special featuresor options may be an archive option. If a user checks off this option,an archive copy of the facsimile or transmission is automaticallygenerated and archived at a storage location. The storage location mayvary depending on the design choice. For example, the storage locationcan be the sender's own computer system. Some other special features oroptions may be document format options. For instance, the document to befaxed or transmitted can be sent as text only within an email or sent asa Word attachment to an email (after using OCR techniques on thedocument), or sent as a PDF formatted attachment to an email (with orwithout selectable text). Based on the disclosure provided herein, othertypes of special features or options will be apparent to a person ofordinary skill in the art. Further details will be given below.

In an alternative exemplary embodiment, the cover page can beminiaturized to the size of small adhesive note sheets, such as,Post-its. A user can still fill in the requisite information on thisminiaturized email cover page. Once completed, this miniaturized emailcover page can then be adhered onto the front page of a document forfacsimile transmission. Subsequent character recognition can be adjustedto heighten the sensitivity needed to locate and identify theminiaturized email cover page on the front page of the document. Due tothe reduced size of the miniaturized email cover page, special markingsor symbols, such as a unique bar code, may be included to facilitate thecharacter recognition that needs to be performed to allow the emailaddresses to be more easily located and identified within theminiaturized email cover page. Miniaturized email cover pages can besold as peel-off pads. When a document needs to be faxed to an emailaddress, a user simply fills in the requisite information on theminiaturized email cover page, peels off the completed miniaturizedemail cover page and affixes it on the front page of the document.

In another alternative exemplary embodiment, an electronic version ofthe email cover page in the form of an electronic file is provided to auser via e-mail or download from a website. In such embodiments, a userobtains the cover page by visiting a web page of a service provider. Insome embodiments, a user may log-into the service provider to obtain acover page customized for the user. The customized cover page may bestored in the form of a .pdf document, or other standardized format(e.g. Word document). In other embodiments, a user need not log-into theservice provider and may obtain a pay-per-use-service cover page, asdescribed herein. When implemented in this manner, the electronic filecan be activated to generate the email cover page on a computer. Theemail cover page is then shown to a user. The user can then directlyinput the desired information onto the email cover page using an inputdevice, such as, a keyboard. Information entered in this manner is morereliable, thereby reducing the number of errors that might occur whensubsequent character recognition is performed. The completed email coverpage can then be printed out and faxed with the desired document.

In addition, in some embodiments, when an electronic email cover page isused to capture the requisite information, some of the capturedinformation, for example, the email address, can be regenerated onanother part of the email cover page. For instance, the email addressmay be reprinted on another part of the email cover page, oralternatively, the email address may be encoded in bar code form, orother machine-readable format, and then be printed as part of the emailcover page. This provides redundancy and further enhances the accuracyof the character recognition that needs to be performed subsequently.

Optionally, certain information on the email cover page may be renderedunreadable to the recipient of the email. For example, the fax numberused by the sender may be printed within a grey scale pattern or thelike, such as, a moiré pattern, in which the fax number is visible tothe eye of the sender before the email cover page is faxed. When faxed,however, the fax number and the pattern will not be distinguishable fromeach other due to the limitations of fax scanning technology therebyrendering the fax number unusable to the recipient.

In various embodiments, an fax-to-e-mail message that is sent, asdescribed below, may not only include a converted document, but also a“return” fax-to-email cover page. In various embodiments, the “return”cover page may be a blank cover page as described herein, or may havesome pre-filled-in data. As an example, a realtor may send a fax to aclient including a document requiring the client's faxed signature inreturn. The realtor may include the client's email address in TO fieldof the cover page, and may include the realtor's email address as a FROMemail address in the cover page. In such an example, the “return” coverpage may have the client's email address in the FROM field on the coverpage, and may have the realtor's email address as the TO email addresson the cover page. In various embodiments, the realtor may also specifyon the “return” cover page that the realtor will pay the service chargefor the return fax/email transmission (e.g. via providing the realtor'sfax-to number). In various embodiments, “return” cover pages with somepre-filled-in data make it more likely the client will respond, and/orwill respond in a timely manner.

Referring now to FIG. 3B, there is shown an illustration of how a userinteracts with the system 5 of various embodiments of the presentinvention to “send” an email from a fax machine 2, according to anexemplary embodiment of the present invention. At step 44, the userfills in the letterboxes, in normal handwriting, with the final emailaddress(es) it wishes to send to, e.g., “john_doe@generic.com”.Alternatively, the email address can be printed in a machine-readableformat. In an alternative exemplary embodiment, the cover page includesan “advanced features page,” which can be downloaded to the user's faxor email address. This advanced features page may also be generated atthe user's computer. The advanced features page permits the user toselect one or more options or services offered by the system 5 such as,for example, creating a group distribution list. In other embodiments,one or more options may be provided on the cover page.

One or more group distribution lists for a particular user can bemaintained by the system 5. For example, one or more group distributionlists may be associated with or linked to a particular sender emailaddress. The email addresses within a group distribution list can bestored by the system 5. When filling out the email cover page, the useronly needs to provide an alias or other identification information for aparticular group distribution list. The system 5 is able to retrieve thesender email address and the alias for the particular group distributionlist from the completed email cover page. The system 5 then looks up thegroup distribution lists associated with the sender email address anddetermines if the alias is associated with one of the group distributionlists linked to that sender email address. If so, the fax will beforwarded to all the email addresses in that group distribution list.

At step 46, the user sends the fax to the telephone number associatedwith the selected POP 10, where it is received by a fax modem bank 20 onfax server 22. Fax modem bank 20 includes an incoming fax spooler 60,which converts the fax to an image file format, which may be, forexample the standard G3 TIFF format and then temporarily stores theimaged fax in a spool area on a local disk drive (not shown in thefigures). The imaged email cover page is then transmitted to one of thefax servers 22 of POP 10 for further processing.

In addition to fax spooler 60, and as is shown in FIG. 5, the softwarearchitecture 70 for each fax server 22 comprises a front page (i.e.cover page) character recognition module 62, a fax-to-email gateway 64,an email-to-fax gateway 66 and an outgoing fax spooler 68.

At step 48, front page character recognition module 62 operates toextract the imaged email address from the imaged email cover page.Preferably, front page character recognition module 62 does this byoptical character recognition (OCR). Optionally, the imaged email coverpage may be cleansed or filtered as many times as is deemed appropriateto remove any undesired markings or patterns before the front pagecharacter recognition module 62 is invoked to perform its functions.Furthermore, as described above, the imaged email cover page may includeredundant information relating to the imaged email address. The frontpage character recognition module 62 can be adjusted to cross-check theredundant information to ensure that the imaged email address isaccurate.

At step 50, the electronic image of the fax is encapsulated andformatted into a MIME-compliant email message by fax-to-email gateway64. “MIME” stands for Multipurpose Internet Mail Extensions and refersto an official Internet standard that specifies how email messages mustbe formatted so that they can be exchanged between different emailsystems. The electronic image of the fax is then transmitted to emailserver 26 as an attachment to the email. In an alternative exemplaryembodiment, certain information is removed from the electronic image ofthe fax before it is transmitted to email server 26. For example, thespecific fax number that is used by the sender may be scrubbed orotherwise rendered unreadable by the recipient of the email.

Upon receipt of the fax image by email server 26, email server 26transmits the delivery status of the email to advertisement andstatistics server (ad/stat server) 24. As shown in FIG. 5, the softwarearchitecture 71 of ad/stat server 24 comprises a confirmation andinstruction page composer 72, a title page composer 74 and a PostScriptrendering engine 76. Confirmation and instruction page composer 72receives the delivery status of the email from email server 26 andsubsequently generates delivery or non-delivery notifications and userinstruction pages in PostScript format.

In an alternative exemplary embodiment, email server 26 and/or ad/statserver 24 may include a real-time billing engine (not shown). Thereal-time billing engine is used to keep track of usage by various usersand generate the appropriate billing information accordingly. Usage maybe tracked in a number of different ways. For example, usage may betracked via minutes used against a specific fax number, number of pagessent, amount of data or the like. In that regard, a user, such as acompany, may be assigned one or more specific fax numbers for use by itsemployees. Usage against each specific fax number may be monitored bythe real-time billing engine. Billing information may be calculated on areal-time basis and made available to authorized users via a website onthe Internet. In addition, the billing information for each fax sent mayalso be included in a confirmation and instruction page as describedbelow.

At step 52, confirmation and instruction page composer 72 generates aconfirmation and instruction page, and, at step 54, retrievesadvertisements from ad/stat server 24 and incorporates theadvertisements into the confirmation and instruction page. Additionally,at step 56, confirmation and instruction page composer 72 retrievesadvertisements from ad/stat server 24, which are incorporated, e.g. inbanner format into the email. In other embodiments, the advertisementsmay be in the form of dynamic advertisements served by an external adserver, such as Google, Yahoo, or the like. In various embodiments, theadvertisements incorporated in the confirmation and instruction page arespecifically targeted to the user's geographic locale, to the user basedupon user profile, to the user base upon relevance of the message sent,or the like. In some embodiments, the system 5 determines the user'sgeographic locale from the user's fax number's prefix and/or area codeand advertisements are then targeted based on demographic datacharacteristic of the user's neighborhood, e.g., average income bracket.In an alternative embodiment, the email address confirmation pageincludes an electronic commerce aspect, wherein the user is providedwith a “check box” on the confirmation and instruction page, which theuser can check to indicate further interest in a particular advertisingoffer. An exemplary embodiment of a confirmation and instruction page isshown in FIG. 6A. Optionally, the confirmation and instruction page mayfurther include thumbnail sketches of one or more of the faxed pages, asshown in FIG. 6B. As shown in FIG. 6B, the service provider name andcompany logo is, of course, considered an advertisement in variousembodiments.

In another alternative embodiment, a toll-based (e.g. 1-900; 1-(areacode+telephone number) (e.g. 1-415, 1-650, 1-847); local telephonenumber; or CIC code (e.g. 10288+number) number is provided to the userat the beginning of the process, i.e., in lieu of step 10 in FIG. 3A, asa pay-per-use service. In such toll-based (e.g. pay per use)embodiments, advertisements may not be delivered to the sender,recipient, or other parties. In some pay-per-use service embodiments,the user may or may not pay to make the local, long-distance, orinternational telephone call, depending on the user's telephone serviceplan. Additionally, in some embodiments, the user is billed for theservice described in various embodiments, via a telephone billassociated with their fax machine, with the phone line, and/or, with thephone number. For example, the user may be billed for the service ofsending a fax to an e-mail recipient via their monthly telephone bill.As will be described further below, in various embodiments, the billingmay be provided to the user's telephone bill directly from thepay-per-use service provider, or via one or more billing intermediaries.In other embodiments, the billing may be arranged directly between theuser and the pay-per-use service provider. For example, the user mayhave an account with the service provider.

In various embodiments, charges for the service may be made per page offax transmission, per minute of connection time, per amount of datatransferred, and the like. For example, the cost may be $2 for the firstminute of connection time, and $0.50 for each additional minute; $3 forthe first page, and $0.25 for each additional page; or the like.Additionally, the time of day may affect the charges, for example,service fees for fax to e-mail transfer illustrated herein may be morecostly during business hours compared to in the middle of the night.

In still other embodiments, a toll-free number (e.g. 1-800) may beprovided to the user at the beginning of the process, as part of anadvertising subsidized service where faxes, e-mail messages, e-mailattachments, and/or the like include advertisements. Such examples wereillustrated in FIGS. 6A-B, above. Additional examples of advertisingsubsidized embodiments will be discussed below.

In one alternative exemplary embodiment, upon receipt of the fax imageby email server 26, email server 26 contacts ad/stat server 24 toretrieve preferences that may be associated with the email that is to begenerated for that fax image. Preferences can be specific format,marketing information, graphics etc. and can be sender-oriented orrecipient-oriented. Information from the email cover page, such as,account number, respective sender and recipient email addresses, faxnumber used by the sender or other unique markings or symbols, can beused to determine the preferences that are to be incorporated into theemail. For example, if a fax is received from a sender using a specificfax number, the email to be generated from that fax may includeinformation about that sender. If the specific fax number is dedicatedfor a particular company, certain company specific marketing informationand graphics may be incorporated into the email to provide branding orstandard look and feel.

In another alternative exemplary embodiment, the confirmation andinstruction page may include dynamic content that is provided based onthe sender's historical and/or past activities or behavior. The ad/statserver 24 may keep track of a sender's historical and/or past activitiesor behavior. For example, the ad/stat server 24 may keep track of thenumber of times faxes sent by a particular sender failed to go throughbecause of poor handwriting or incorrect recipient email address. Thead/stat server 24 may even keep track of the type of problems thatcaused past failures, such as, a sender's handwriting of the letters “v”and “u” repeatedly caused faxes to fail to go through. Based on thesender's historical and/or past activities or behavior, the ad/statserver 24 then provides the appropriate information to the email server26 to be included in the confirmation and instruction page. Suchinformation may include, for example, tips or helpful hints to avoidproblematic handwriting.

After the confirmation and instruction page has been composed, it israsterized into a fax encoded bitmap image by PostScript renderingengine 76 and then sent to fax server 22 where outgoing fax spooler 68operates to store the rasterized confirmation and instruction page on alocal disk drive for subsequent delivery. Because bitmap image renderingis a computationally intensive process, a custom load-sharing softwarefor distributing the rasterization process between a number of faxservers 22 machines may be employed as an alternative embodiment.

In another alternative exemplary embodiment, for promotional ormarketing purposes, the email may further include a link that allows arecipient to use the services provided by the system 5 on a trial basis.The recipient/trial user may click on the link and be directed to awebsite. The website may show the trial user a trial offer and promptthe trial user to enter his/her email address to receive the trialoffer. Assuming the trial user decides to take the trial offer andenters his/her email address, an electronic version of the email coverpage is forwarded to the provided email address. This email cover pageincludes a specific fax number that is valid only for trial purposes.For example, this specific fax number may only be used for a limitednumber of fax transmissions. When the trial user uses the servicesprovided by the system 5, the emails sent by the trial user similarlyinclude links that allow the recipients to try the services, asdescribed above.

At steps 58, the email (with the advertisements) is sent over theInternet to the intended recipient using, for example, SMTP protocol,including an attachment in a standard format, e.g. GIF file, .pdf, .jpg,.bmp, .tiff, etc. viewable on a variety of different computing platformswhere emails messages may be received.

In an alternative exemplary embodiment, a link to the email is sent overthe Internet to the intended recipient. The link is created dynamicallyfor each email. More specifically, the address for the link is randomlygenerated for an email on an ad hoc basis.

This is done to protect against unauthorized access of the email. Theintended recipient may then click on the link to retrieve and view theemail.

Optionally, upon the intended recipient clicking on the link and viewingthe email, a receipt is generated and forwarded to the sender to confirmthat the intended recipient has received the email.

Optionally, when a link is used to access the email over Internet, asecurity mechanism is provided to allow only authorized access to theemail by an intended recipient. FIG. 9 is a flow diagram illustratingexemplary operations of the security mechanism. As shown in FIG. 9, whena user receives a link, at 90, s/he clicks on the link to request accessto the email or fax. By clicking on the link, the user in effectcontacts a security manager 92 that controls access to the email. If thesecurity manager 92 determines that the user is an authorized recipient,then access to the email is granted and, at 94, the security manager 92may then send the email to the user. One way to determine that the useris an authorized recipient is for the security manager 92 to first checkif the user has logged in with the security manager 92. If the user haslogged in with the security manager 92, then certain credentialsassociated with the user is available. The credentials may include, forexample, a session ID which is tied to the email address of the user.The security manager 92 then checks the email address of the userretrieved based on the credentials against the email address of theintended recipient of the email. If the two email addresses match, thenthe user is an authorized recipient of the requested email.

On the other hand, if the two email addresses do not match, then theuser is validly logged on but is not an authorized recipient of therequested email. Then, at 96, the security manager 92 invokes an errorhandler routine 98. At 100, the error handler routine 98 informs theuser that access to the requested email is denied because the user isnot an authorized recipient. Optionally, at 102, the error handlerroutine 98 logs the denied request for archival and/or securitypurposes.

If the user is not logged in with the security manager 92, then at 104the security manager 92 prompts the user to login. To login, at 106, theuser presents his/her email address or user name and password. Thepassword is given at the time the user registers with the securitymanager 92. If the email address/user name for the user and the providedpassword match those maintained by the security manager 92, at 108, theuser is considered logged in and credentials such as a session ID areforwarded to the user. Once the user has the credentials, the process asdescribed above can be repeated to determine if the user is anauthorized recipient.

If the user is not a registered with the security manager 92, i.e., theuser does not have a password associated with his/her email address, theuser is then prompted to register with security manager 92. To registerwith the security manager 92, at 110, the user provides his/her emailaddress. Upon receiving the email address, the security manager 92generates a password that is linked to that email address and, at 112,forwards the password to the user. The security manager 92 also createsan account for the user for future reference.

Finally, at step 59, the confirmation and instruction page is sent tothe user for confirmation purposes, the confirmation and instructionpage possibly incorporating an advertisement as explained above. Forexample, the confirmation and instruction page can be sent over the POTSto the user in the form of a confirmation fax if a fax number for thesender is available; similarly, the confirmation and instruction pagecan also be sent to the user in the form of a confirmation email or as apart thereof.

In an alternative exemplary embodiment, the confirmation and instructionpage may also be sent to other e-mail addresses. For example, if the faxthat is sent relates to company business, a confirmation copy of theemail generated from that fax may be forwarded to the company's archiveor storage facility for storage or archive purposes. In one example, theuser may specify the archive or storage facility via the specificationof a specific account in one field. For example, one transmission mayinclude a CC field entry of “03111995@webpost.com.” In this example,“03111995” represents the account number, and “webpost.com” representsthe server the transmission may be sent to. Additionally, in thisexample the CC and/or BCC field entry includes “moldreport.pdf.” In thisexample, the transmission attachment is then stored under the name“moldreport.pdf” for storage at “webpost.com” in account number“03111995.” Custom fields for specification for such data are disclosedin FIG. 11. In light of this disclosure, one of ordinary skill in theart can imagine many other embodiments of the present invention.

At this point, it should be emphasized that, whereas the softwaremodules of the software architecture of FIG. 5 are shown to bedistributed over multiple servers, one skilled in the art wouldunderstand that all the software modules could reside on a single serveror on different servers than is shown in the embodiment of FIG. 5.

In an alternative exemplary embodiment, a user can interact with thesystem of various embodiments to send a facsimile from any standalonefacsimile machine to any other standalone facsimile machine. To do this,the user procures a “facsimile number page,” as for example, similar toprocuring the “email cover page” described above in relation to steps 40and 42. The user then enters a facsimile number of the intendedfacsimile recipient, for example, in handwritten format or printedmachine readable format, and then faxes the facsimile to the localnumber of the selected POP 10 as in steps 44 and 46 described above (or,alternative, enters a pay-per-use toll-based number as is also describedabove). Upon receipt of the facsimile by the selected POP 10, thefacsimile number is then extracted and the electronic image of thefacsimile is formatted into a MIME-compliant email message byfax-to-email gateway 64, similar to steps 48 and 50 above. Next, emailserver 26 transmits the MIME image to an email-to-fax gateway 66, whichcould reside on a different POP 10, where the email-to-fax gateway 66converts the MIME image into a text-formatted (e.g. PostScript) file.Then, PostScript rendering engine 96 operates to rasterize thetext-formatted file into a fax encoded bit map image. And, finally,outgoing fax spooler 68 receives the fax encoded bit map image andtransmits it to the intended facsimile recipient.

In yet another exemplary embodiment of the present invention, web pagescan be downloaded via fax. In this embodiment, a user is provided withan “email cover page” as described above. This email cover page providesletterboxes for entering the desired web address (which, for example canbe entered in normal handwriting or printed in a machine readableformat) and an indicator of some sort, which the user can use to requestthe number of pages from the web address the user wishes to download.One type of indicator on the cover page, for example, could be a seriesof bubbles positioned at predetermined positions on the cover page.

Referring now to FIG. 7, there is shown a network operations center(NOC) 8, according to an exemplary embodiment of the present invention.NOC 8 functions as the system headquarters and is configured tocommunicate with all POPs 10, as was shown and described in reference toFIG. 1. NOC 8 comprises an Internet access router and firewall component(IP router) 82 coupled between the Internet via, for example, a T1channel service unit (CSU) 84 and an Ethernet switch 86 (at a data rateof, for example, 100 Mbps); a web server 88 coupled to IP router 82; aprivate branch exchange (PBX) 90 coupled to the telephone network via,for example, a B-1 line; an interactive voice response (IVR) unit 92coupled to PBX 90 and a computer-telephony integrated (CTI) server 94coupled between IVR unit 92 and Ethernet switch 86. Also coupled toEthernet switch 86 is an NOC statistics server 96; an NOC advertisementstatistics server 98; NOC workstations 100; andadministrative/development workstations 102.

In the various embodiments, computer code is stored and executed withintangible memory of NOC 8 to effect the functions described herein.Additionally, the tangible memory may be used to stored facsimiletransmissions, format converters, status data, optical characterengines, advertisement engines, operating systems, and other types ofdata describe in the present patent application. In various embodiments,tangible media may include magnetic media such as floppy disks, harddrives, network storage devices and removable hard disks, opticalstorage media such as CD-ROMS, DVDs, holographic memory, and bar codes,semiconductor memories such as flash memories, read-only-memories(ROMS), and battery-backed volatile memories, and the like.

NOC advertisement statistics server 98 stores, and makes available toadvertisers, statistics relating to the advertiser's advertisement(s),for example, the number of times the advertisement was sent, the numberof positive responses from viewers of the advertisement, a qualitativemeasure of the party the advertisement was sent to, etc.

NOC administrative/development workstations function as a help desk tothose users who log on to web server 88 and also allow the systemprovider to do development, for example, improving the functionality ofthe web site provided by web server 88.

IVR unit 92 permits a user to dial into the NOC via PBX 90 using thesame 1-800 toll free access number used in the initiation of afax-to-email process described above, or the like. IVR 92 providesuser's with voice prompts, which the user can respond to using thetelephone keypad. The prompts may relate to, for example, useinstructions or may permit a user to download information from theInternet, e.g. stock quotes, weather predictions, travel information,etc.

In another embodiment of the present invention, a user can logon to webserver 88 from, for example, a computer workstation 4 (See FIG. 1), andthen send a fax from an email to any standalone fax machine. Anexemplary process for accomplishing this is shown in FIG. 8A.

At step 110, after the user logs on to web server 88 (See FIG. 7), theuser sends an email to web server 88. Then, at step 112, web server 88captures and stores the user's email address and the fax number to whichthe user wishes to send the fax. This information is relayed over theInternet to email server 26 of the, preferably, nearest POP 10, to whichthe fax number is associated. As shown in FIG. 5, each email server 26contains a mail transfer agent 39, which accepts the email from NOC 8.Email-to-fax gateway 66 then operates to convert the email message intoPostScript text.

At step 114 title page composer 74 generates a return fax page, and, atstep 116 retrieves advertisements from ad/stat server 24 andincorporates the advertisements into the return fax page. Preferably,the advertisements are specifically targeted to the fax recipient'slocation. The system 5 determines this from the recipient's fax number'sprefix and area code by comparing the numbers to area code and prefixnumbers stored in ad/stat server 24. Once the neighborhood isidentified, advertisements are then targeted based on demographic datacharacteristic of the recipient's neighborhood, e.g., average incomebracket. In an alternative embodiment, the return fax page includes anelectronic commerce aspect, wherein the fax recipient is provided with a“check box” on the return fax page, which the recipient can check toindicate further interest in a particular advertising offer.

After the return fax page has been composed, it and the converted faximage are rasterized into a fax encoded bitmap image by PostScriptrendering engine 76 and then sent to a fax modem bank 20 of POP 10 whereoutgoing fax spooler 68 operates to store the rasterized fax and returnfax page on a local disk drive for subsequent delivery.

At step 118, the fax and return fax page are sent over the POTS to thefax recipient.

Referring now to FIG. 8B, at step 120, upon receipt of the fax andreturn fax page, the fax recipient uses the return fax page to reply tothe fax and sends the reply fax at step 122.

At step 124, title page composer 74 of ad/stat server 24 operates togenerate a confirmation page incorporating a second advertisement, whichis then, at step 126, sent back to the return fax page user. Steps 124and 126 substantially follow the steps 54 and 59 as described inreference to the fax-to-email process of FIG. 3B.

The advertising subsidized aspect of the system and method of variousembodiments of the present invention also allows a user to send a faxfrom any standalone fax machine to any other standalone fax machine forfree, thereby avoiding long distance telephone charges, which aretypically billed for any long-distance fax transmission. To accomplishthis, a user simply dials the toll free (1-800) access number, asexplained above, to obtain a local number to a POP 10. Local POP 10 thenresponds by faxing back a cover page to the user. Steps 44 through 48are then performed, as was described in relation to FIG. 3B, followed bysteps 110 through 118 as was described previously in relation to FIG.8A. The only difference from the process as described above would be toprovide letterboxes for fax addresses on the cover page and provide forOCR capability for extracting fax addresses.

In another alternative embodiment of the present invention, NOC 8includes a local database (not shown in FIG. 7), which is configured tostore a frequent user's email address book. The user can logon to webserver 88, upload the address book and associate nicknames or real nameswith each email address (e.g. “John Doe” for john_doe@generic.com). Bydoing this, the user can then send emails from any standalone faxmachine simply by filling in the letterboxes of the email cover page (asdescribed previously with respect to FIG. 3B) with the nickname or realname of the intended recipient.

Finally, in another exemplary embodiment of the present invention,advertisers are provided with a “dynamic print advertising” service,whereby an advertiser can logon to web server 88 of NOC 8, open anaccount, create advertisements and customize them based on specificdemographic information.

Various embodiments of the present invention as described above can bedeployed in many different applications. FIG. 10 is a simplified blockdiagram illustrating an exemplary application in accordance with thepresent invention. As shown in FIG. 10, a user 200 faxes a documentusing the system 5 as described above. The faxed document is received bya server 202 and put in a processing queue to await processing. When thefaxed document is processed, an email generated based on the faxeddocument is forwarded to a compliance/authorization officer 204. Theemail may be delivered to the compliance/authorization officer 204 usinga number of different methods; but preferably, the email is deliveredthrough a secure website or a virtual private network. In thisparticular application, the compliance/authorization officer 204 reviewsthe email to determine if it is allowed to be sent to its intendedrecipient. After the email has been reviewed, thecompliance/authorization officer 204 relays its approval/rejection backto the server 202 for further actions. If an approval is given, then theserver 202 forwards the email to the intended recipient. Optionally, aconfirmation for delivery may be forwarded to the user 200. On the otherhand, if a rejection is given, then the server 202 prevents the emailfrom being sent to the intended recipient and informs the user 200 ofthe actions taken. Based on the disclosure provided herein, a person ofordinary skill in the art will know of other ways and/or manners toapply various embodiments of the present invention.

In an alternative exemplary embodiment, the system 5 is capable ofhandling inputs having different types of electronic formats. Forexample, instead of a user sending a document via a fax machine, theuser may choose to first use a scanner to scan the document into ascanned image. The scanned image of the document is then forwarded tothe fax server 22. Depending on the scanning technology used to producethe scanned image, the fax server 22 accordingly converts the scannedimage for processing as described above. Based on the disclosure andteachings provided herein, a person of ordinary skill in the art will beable to implement various embodiments of the present invention to handleinputs with different types of electronic formats.

In light of the above, various embodiments allow a user to, among otherthings, send a fax or other electronic communication from stand-alonefax machine, scanner, or the like. Based upon the data graphicallyincluded on the fax or other electronic communication, the fax or otherelectronic communication is routed to the appropriate destination. Forexample, the communication may be routed to an e-mail inbox,

Novel Template Cover Page

FIG. 11 illustrates an example of a novel template page (cover page),which may be optically digitized via a facsimile machine. In variousembodiments, the fax template page is derived from an Adobe .pdfdocument type that is opened via Adobe Reader™, Acrobat™, or similarsoftware. In various embodiments, the fax template page includes“fill-in” capability, that allows the user to type-in information ontothe page. As will be described in-depth below, within the template page,the user may enter a variety of data and may make a number of functionalchoices for transmission purposes.

In other embodiments of the present invention, the template page can bederived from other sources. In one example, the template page may bederived in response to a web-based form submission where the user inputsdata on a web form, as was mentioned earlier. In such an example, whenthe user is finished typing-in data, the web server provides a user witha digitized representation of a filled-in template page she canprint-out, or save electronically. In an alternative embodiment, forsecurity and accounting purposes, the filled-in template page may besent to the FROM sender's e-mail address. In some embodiments, the webserver, or the like checks whether the sender's e-mail address isauthorized to receive the template page, before sending the filled-intemplate page.

In off-line embodiments, the template page may be derived from anoffice-productivity macro plug-in, such as Word, Excel, or the like thatprompts the user for information. In such examples, after the userenters the data, the data automatically populates fields within in adocument. The document can then be printed out, “printed-to-file” in thecomputer, or the like.

In the embodiment in FIG. 11, a number of fields are illustrated. Inother embodiments, a greater or fewer number of fields may be used forthe template page. In FIG. 11, the template page 400 includes a to field410, a carbon copy field 420, a blind carbon copy field 430, a fromfield 440, a subject field 450, a filename specification field 460,custom fields 470 and 480, and a notes field 490.

As will be described below, fields 410-480 typically include human andmachine readable data upon which optical character recognition (OCR)techniques operate, so as to determine the transmission destinations,e.g. e-mail addresses of the sender, cc recipients, the receiver, faxnumbers, or other destinations. If OCR techniques provide ambiguousresults, a human operator may review data entered in these fields inorder to attempt to determine the intended e-mail addresses, or thelike. In various embodiments, a human operator may also provide feedbackto the sender regarding the quality of the transmission, e.g. thescanner or fax machine has a dirty scanning surface, or the like.

Importantly, data in notes field 490 and any page after template page400 is inaccessible to human operator review while in transit from thesender to the recipient. Such data is kept in encrypted form on typicaltransmission servers. Accordingly, any confidential data within notesfield 490 and within the document are secure and cannot be accessed orrelied-on by an operator.

In some embodiments of the present invention, when a filled-in templatepage 400 is received by a server, images of fields 410-480 are extracted(along with bar codes 590 and 600, described below) from the originaltransmission. The images are then recognized using OCR techniques toattempt to recognize the routing data (e.g. e-mail addresses, faxnumbers, data format and the like). After the data from fields 410-480are recognized and used for transmission purposes, the data may bediscarded, may be used for billing or logging purposes, etc. Any otherdata present in the original transmission besides specified portions oftemplate page 400 are not viewable, and the transmission is kept secureand confidential. Additionally, after the original transmission has beentransformed and sent to the appropriate destinations, the originaltransmission and the sent transmission are deleted and cannot berecovered. Some embodiments may allow a compliance officer, or the like,to review the transmission before it is sent, as was described above,and will be discussed further below.

As shown in FIG. 11, a variety of functional options are provided intemplate page 400 including an option 500 to make the filled-in datasearchable, an option 510 to electronically archive the transmission, anoption 520 to initiate a certification process for time-stamped deliveryor access of a transmission, an option 530 to provide an electronic postmark receipt, an option 540 to imprint a digital watermark to thetransmission, options 550 and 560 for two-sided document transmissions,option 570 to indicate whether the hand-printed data should haveprecedence over any machine-recognized data on fields such as To field410, Carbon copy field 420, blind carbon copy field 430, from field 450,and the like.

In various embodiments, when the filled-in data are selected to besearchable (option 500), optical character recognition techniques may beused to convert the digitized representation of the document intosearchable text (e.g. ASCII characters) and graphics. Other types of OCRengines may be used to recognize characters of other written languagessuch as Chinese characters, Japanese Kana characters, Korean phoneticcharacters, Hebrew characters, Arabic characters, and the like. In oneembodiment, a text file based upon the recognized text may be providedto the recipient, as mentioned above. In another embodiment, where thedocument is converted into a .pdf format, the recognized text is storedas part of the .pdf file, however is not typically visible to the user.Instead, the user typically views the digitized representation of thedocument. In some embodiments, the searchable text may be searched forarchiving purposes, advertisement purposes, or the like, as will bediscussed below.

In other embodiments of the present invention, where the digitizedrepresentation of a document is to be stored in an electronic dataarchive, data warehouse or the like, the searchable text may be used fordocument indexing of the digitized representation in the data archivingsystem. The document may subsequently be identified within the dataarchive based upon the indexed terms. For example, words from thedocument that are repeatedly recognized by the OCR may be used as keywords. For example, a transmission including a digitized representationof a home loan application may be associated with the key words “homeloan” and/or “application for home loan.” In such examples, the receivedtransmission may be converted from the facsimile format, for example,into another form, such as a .PDF format, and the .PDF format documentmay be stored in a file management system under the key words “homeloan” and/or “application for home loan.” In other embodiments, the keywords used may be manually specified by the sender of the transmission.For example, the user may specify the key words for OCRing in subjectfield 450, custom fields 470 and 480, notes field 490, or the like.

In other embodiments of the present invention, where the digitizedrepresentation of a document is to be stored in an electronic dataarchive, data warehouse or the like, the filename and location of thearchive may be provided in subject field 450, filename field 460, customfields 470 and 480, notes field 490, TO field 410, CC field 120, BCCfield 130, FROM field 140, or the like. As one example, the user mayspecify the archive server or storage facility via the specification ofa specific account in one field. For example, one transmission mayinclude a TO field 410 entry of “09101960@webpost.com.” In this example,“09101960” represents the account number of the user, or the like, and“webpost.com” represents the server the transmission may be sent to.Additionally, in this example filename field 460, CC field 120, or thelike includes “Lawrence Wells Fargo Statements.pdf.” In this example,the transmission attachment is then stored under the name “LawrenceWells Fargo Satements.pdf” for storage at “webpost.com” in accountnumber “09101960.” In various embodiments, any number of transmissionprotocols may be used by NOC 8, POP server 10, or the like, to post thedocument at the desired location, such as FTP, a secure protocol, or thelike. In light of this disclosure, one of ordinary skill in the art canimagine many other embodiments of the present invention.

Also shown in FIG. 11 is a transmission tracking number 580.Additionally bar codes 590 and 600 are illustrated at differentorientations and different positions on template page 400. In someembodiments, transmission tracking number 580, and barcodes 590 and 600are generated within Adobe Reader™/Acrobat™ and implemented as a plug-inapplication. Further details will be given below.

In some embodiments of the present invention, less than all of the abovefields and options may be provided on the template page. For example, inone embodiment, simply to field 410, and from field 440 are supported,in another embodiment, To field 410, from field 440, and subject field450, are included on the template page, etc.

In still other embodiments, additional types of services may be providedby the service provider based upon options selected on the cover page.Additional options that may be provided to a sender may include: crop,enlarge/reduce, N-up, vcard, other copier /printer/multi-functionmachine functions, such as collate, as described herein, N number ofduplicates, fit-to-page, watermarks/borders, rotate, deskew/straighten,key-stone correction, warp, increase or decreasecontrast/brightness/gamma, sharpen/blur, or the like. The inventors alsorecognize that other types of image manipulation functions, provided insoftware such as PhotoShop, PaintShopPro, or the like may also beprovided in various embodiments, such as warping, perspectivecorrection, layering, adding frames, red-eye correction, imagesoftening, or the like. Combinations of these types of functions may beselected by the user, as will be seen in the examples.

In one embodiment, a sender of the document may specify portions of afaxed document or scanned document for enlargement. For example, a usermay specify an enlargement option of a cover page, and draw a thickblack region around a portion of one of the pages to scan/fax. Inresponse, the transmission server may identify the location of the thickblack region from one or more of the pages, and enlarge the contents ofthe box, until it fills the page. For example, a page may be a frontpage from a newspaper, and a thick black box may highlight a specificarticle. In response the portion of the front page that is highlighted(including the article) may be enlarged to “fit to page” when sent tothe recipient. In other embodiments, the amount of zoom or de-zoom maybe specified by the sender via characters that are OCRed by thetransmission server, via mark-sense-type marks, or the like.

In a related embodiment, the sender may specify N-up deliver of ane-mail attachment, or the like. For example, a fax may include 20 pages,but when the sender specifies 4-up printing, the resultant e-mailattachment (electronic document) may include only 5 pages. Each pagewould thus include representation of 4 pages of the original fax. Inother embodiments, N may be virtually any specifiable number of pages,such as 2, 3, 4, 6, 8 or the like. The number N may also be determinedby the transmission server via OCR characters, via mark-sense marks, orthe like.

FIGS. 17A-D illustrates examples according to various embodiments of thepresent invention. More specifically, FIGS. 17A-C illustrate someexamples of copier-type (image processing-type) operations that a usermay specify to be performed upon digitized documents that are faxed toembodiments of the present invention.

In the example in FIG. 17A, a facsimile is transmitted to a transmissionserver for retransmission as an e-mail attachment. In FIG. 17A, a userselects one or more options 1000 on a transmission instruction page. Inthis example, the selected options include duplication and fit-to-page(zoom) crop. As can be seen, the user may specify a region 1010 in adocument they are interested in enlarging, via a dark border, or thelike. The transmission server optically recognizes the e-mail address,as previously described, and these user-selected options. In response,as illustrated, the bordered region is zoomed to fit on the page, andmultiple copies 1020 are delivered.

In the example in FIG. 17B, a user selects one or more options 1030 on atransmission instruction page. In this example, the selected optionsinclude de-zoom (N-up printing) and a crop. As can be seen, the user mayspecify a region 1040 in a document they are interested in cropping, viaa dark border, or the like. The transmission server optically recognizesthe e-mail address, as previously described, and these user-selectedoptions. In response, as illustrated, two pages of the document areoutput 1050 in a 2-up printing configuration, and the bordered region iscropped.

In the example in FIG. 17C, a user selects one or more options 1060 on atransmission instruction page. In this example, the selected optionsinclude a de-skew operation, a watermark option, and a border option. Ascan be seen, pages of document 1070 may be skewed or the like duringtransmission. The transmission server optically recognizes the e-mailaddress, as previously described, and these user-selected options. Inresponse, as illustrated, a border 1100 (or other graphic) may beretried by the transmission server and overlaid upon document 1070. Asalso illustrated, skew pages of document 1070 may be straightened, orthe like. In this example, the watermark 1090 (and/or the border) isprovided by the user to the transmission server during the transmission.In the example shown in FIG. 17C, the watermark 1090 may be specified asthe last page of the facsimile transmission, may be the page immediatelyafter the transmission instruction page, or any other page. For example,the user may specify on the transmission instruction sheet, whichnumeric page is the watermark/border page. In another example, the usermay place a mark at a predetermined portion of that page, to indicatethat page as a watermark/border. Many other methods of providing suchfunctionality are envisioned by the Inventors in light of the presentdisclosure.

In other embodiments, may other combinations of copier-type or otherfunctions may be selected by the user. In other embodiments, certaintypes of options are automatically selected (defaulted), and may bespecifically removed by the user. For example, the user may have adefault operation to have all their transmissions include aconfidentially watermark, in such cases, via the transmissioninstruction page, or the like, the user may select to suppress theconfidentially watermark for a particular transmission.

In another embodiment, a sender may specify that the facsimile is abusiness card, or other “standardized” type of form. In suchembodiments, the information included in the business card may be OCRedto obtain business contact data. Next, the transmission server may takethe business card data and format it into a standardized electronicbusiness card format, such as a vcard, hcard, or the like. As anexample, a user may specify their own e-mail in a fax cover page, andcheck a vcard option box. In response, the transmission server receivesthe fax (cover page and business card), and OCRs the e-mail address andthe business card data. The transmission server then forms an e-mailmessage to the sender e-mail and includes a vcard attachment based uponthe business card data. Additionally, a .pdf, or the like of thebusiness card may also be sent. The vcard data received by the sender inthe e-mail message may then be included into a contact managementapplication (e.g. Outlook), or the like. An example of this isillustrated in FIG. 17D.

In the example in FIG. 17D, a facsimile is transmitted to a transmissionserver for retransmission as an e-mail attachment. In FIG. 17D, a userselects one or more options 1110 on a transmission instruction page. Inthis example, the selected options include converting a business card1120 to a vcard (or similar) attachment format. The transmission serveroptically recognizes the e-mail address, as previously described, andthese user-selected options. In response, as illustrated, an e-mailattachment includes an image 1130 of the business card. In addition, thetransmission server optically detects text from a business card 1120 andpopulates appropriate data fields of a vcard (or similar) file. Asshown, the recognized text and data fields may be stored in the form ofan additional e-mail attachment, such as a .vcf file, 1140, or the like.

One significant advantage to embodiments for adding contact information,such as business cards, as described above, includes that no additionalbusiness card scanner hardware or dedicated OCR software would berequired on the user's system. Thus, a user could simply send a fax froman ordinary fax machine and have an e-mail sent to herself that includedthe vcard attachment (.vcf). The user would simply add the vcard to here-mail contact management system via a click of a button. Suchembodiments can now provide simple contact management abilities to usersusing PDA's, smartphones, or the like, for business travelers, or thelike.

In still other embodiments, the inventors of the present invention nowrecognize that many other types of traditional copier machine-typefunctionality are now enabled using the architecture described herein,such as: adding specified margins, adding header or footer data,removing border data, number of duplicate pages, output paper size,document orientation (e.g. portrait, landscape), automatic insertion ofpre-formatted document breaks, resolution, resolution, smoothingfunctions, descreen functions, sorting, print order (e.g. back to front,or front to back), and the like. Accordingly, as can be seen, theinventors of the present invention recognize that a fax machine maybecome a general purpose scanner for users.

Billing Issues

In some embodiments of the present invention, where the template page isfor a facsimile, a dial-in fax number listed on template page 400 isassociated with a particular organization. Accordingly, billing to theorganization may be tracked based upon the traffic sent to the listeddial-in fax number. In other embodiments, the billing may be based uponthe telephone number of the senders' sending fax. In such cases, anumber of sending fax numbers may be associated with a particularorganization, and as faxes are received from these sending fax numbers,the usage may be billed back to the particular organization bytransmission server 5.

Some embodiments of the present invention may be embodied as a publickiosk fax machine or the like. Such kiosks may be found in airports,libraries, hotels, convention centers, and the like. In suchembodiments, a magnetic stripe reader, smart card reader, keypad orkeyboard, coin and bill slots, a biometric input device and the like maybe provided allowing the user to provide payment for services. Forexample, for payment, a user may swipe a credit card and enter a billingzip code; a user may swipe a bank card or debit card and enter apassword; a user may use a smart card reader and enter a password, orother secure stored value or credit card or token; a user may inputpaper or coin currency or the like. After a user document is scanned, orthe like, and only after the appropriate payments have been made orpayment source identified, the kiosk machine sends the scanned documentto system 5 in FIG. 1 for processing, as described above.

In various embodiments, by a sender taking the action of sending atransmission through the embodiments described above, the sender agrees(via contract, subscription, “click-through” agreement, or the like) tobe billed for the transmission service. In such cases, language to thiseffect is explicitly stated on the template cover page. In anotherembodiment, a sender may be required to sign at a pre-determinedlocation of the template cover page, or the transmission will not beprovided. Appropriate optical detection techniques may be included intransmission server 5 to detect and to log a sender's signature. In somecases, if the signature were missing, an e-mail may be sent to the FROM:e-mail address indicating the problem. It is contemplated that thedigitized representation of the document not be provided in suchexamples, to reduce fraud. In embodiments where signatures are required,appropriate contractual language may be explicitly stated on thetemplate cover page next to the signature line.

In light of the embodiments above, where the user agrees to be billedfor the transmission services, any number of methods may be used tosettle the bill such as via direct billing, via third-party paymentmechanism, (e.g. Visa, PayPal,) or the like.

In some embodiments, tracking and/or billing for the services may bebased upon the transmission, bill-to, or charge party telephone numberof the sender, or the like. In such cases, the sender may call-into ageneral fax number coupled to transmission server 5 via a direct inwarddial (DID) local or long-distance number, a toll-free number (e.g. 800,888), a toll-based number (e.g. 900, area code number), or the like. Invarious embodiments, the sender's transmission/billing telephone numbermay be determined and provided to transmission server 5. In variousembodiments, this information may be obtained via Automatic NumberIdentification (ANI) service, specially configured hardware/softwarethat provides the bill-to-number (BTN), ANI, Charge Number ID, or thelike.

The inventors of the present invention have realized that conventionalCalling Party Number (CPN) (e.g. Caller ID) or Calling NumberIdentification (CNI) Service provided by to transmission server 5 by atelephone carrier may or may not reflect the actual calling telephonenumber of the user. Various reasons for this include that the Caller IDnumber may be provided by a private PBX operated by the private partythat may not accurately identify the actual caller telephone number. Asan example, telephone calls from different (direct outward dialing)extensions at a business may all show the same Caller ID number such asthe main switchboard number and not the DID telephone number.Additionally, in other cases, the Caller ID number may be spoofed,forged, or manipulated. In some cases, the CPN (Caller ID) number maynot be transmitted to transmission server 5, per privacy request of theuser.

In light of these limitations above for Caller ID signals, embodimentsof the present invention may alternatively use Automatic NumberIdentification (ANI) to identify the user's telephone number. Usage ofANI to identify callers of toll-free calls (e.g. 800, 888, 877, 866, (inthe future possibly 855, 844, 833, 822), 911 calls), and of toll-calls(pay per use calls) (e.g. 900, 976 calls) is well-known to theinventors. Even though a user/caller may request privacy, the ANI orequivalent number is still generally provided to recipients.

A typical small business may not receive the ANI (also known as abill-to-number (BTN))/Charge Number ID (CNID)/or the like when using alocal DID number, because typically a large, expensive telephoneswitches are required to receive the data. In particular, it is believedthat because the BTN/CNID/ANI/or the like is transferred as an out ofband signaling system 7 (SS7) signal, it requires a SS7 switch. Invarious embodiments of the present invention, a telephone serviceprovider substitutes the standard Caller ID field with the BTN/CNID/ANIfield, and then transmits the BTN/CNID/ANI to the transmission server.Accordingly, the transmission server can thus be provided with theBTN/CNID/ANI field without investment into a dedicated SS7 switch.

In some cases, the sender's telephone number may be associated with aspecific organization that has a direct billing relationship withtransmission server 5. Accordingly, the specific organization may bedirectly billed for the service (e.g. fax to e-mail transfer service,fax to archive transfer service).

In some embodiments, the sender's telephone number is not associatedwith a specific organization and further, the template cover pageincludes language that the sender agrees to pay for the transmissionservice. In various embodiments, the language on the template cover pagemay specify how the transmission service is billed. In one embodiment,the user agrees to pay for the bill via their local telephone bill fromwhich the sender is calling from. Such mechanisms include “casualbilling” practices as is currently used in the telephone industry, andis described further below.

FIG. 16 illustrates a overview diagram according to another embodimentof the present invention.

In the diagram 800 in FIG. 16, a fax machine or scanner 810 is coupledto a transmission server 820, typically over telephone line 900 viatelephone service provider 980. In various embodiments, transmissionserver 820 is coupled to provide a formatted representation of afax/scanned document to destinations such as a document archive 830, ane-mail server 840, a compliance server 850, or the like, as describedabove. Additionally, in FIG. 16, transmission server 820 may be coupledto one or more billing intermediaries 910 and 920, who are coupled toone or more phone companies 930-960. Types of telecommunicationscompanies may include: a local exchange carrier (LEC), a Regional BellOperating Company (RBOC), a competitive local exchange carrier (CLEC),an incumbent local exchange carrier (ILEC), an interexchange carrier(IXC), foreign telecommunications company, or the like. In this example,LEC 930 is associated with a telephone (telephone line, telephonenumber, etc.) coupled to fax machine/scanner 810. Another LEC 970 isalso shown, but not associated with a billing intermediary.

In operation, a user 890 scans/faxes a document via fax/scanner 810using any of the embodiments described herein. For example, using coverpage 400 in FIG. 11, including characters indicating an electronicdestination for the transmission. In this example, the transmission isdelivered via telephone line 900 to transmission server 820 viatelephone service provider 980.

In various embodiments, telephone line 900 (telephone number) isassociated with user 890, a company or organization associated with user890, or a company providing a service to user 890 (e.g. hotel businessservice, a copying services store, or the like.) When fax/scanner 810calls transmission server 820, telephone service provider 980 receivesthe ANI number associated with telephone line 900. As discussed above,in various embodiments, telephone service provider 980 provides theANI/BTN/CNID/or the like number to transmission server 820.

In various embodiments, transmission server 820 receives thetransmission and receives the ANI/BTN/CNID or the like number.Transmission server 820 may monitor the size of the transmission, theduration of the call, the number of pages, or the like, for billing forthe service. Additionally, transmission server may determine whichservices are being requested, also for billing purposes. For example,each of the options 500-570, described and illustrated in FIG. 11, maybe associated with an additional billing service charge. Generally,based upon characteristics of the transmission, and the selectedoptions, a service charge is determined.

In various embodiments, the service charge, a service description of theservice charges, and the ANI are then provided to one or more of billingintermediaries 910 and 920. In the present example, billing intermediary920 has a “casual billing” arrangement with LEC 940-960, but not LEC930. Accordingly billing intermediary 920 may report that the servicecharge cannot be billed. In the present example, billing intermediary910 has a “casual billing” arrangement with LEC 940-960 and LEC 930. Asdiscussed in this example, because LEC 930 is associated with telephoneline 900, LEC 930 can bill user 890, and billing intermediary 910accepts billing responsibility for the service charges, the servicedescription, the ANI, and the like. Eventually, the service charges, andthe like are provided to LEC 930 who then presents the service charges,and the like via a conventional telephone bill 990, or the like.

In some embodiments of the present invention, once the billingarrangements have been approved, as described above, transmission server810 may operate as described in various embodiments herein. For example,a transmission may be reformatted into a document 860, or the like, andbe posted to a computer network location; the transmission may bereformatted into an attachment 870 to one or more e-mail messages, andsent along with the e-mail messages; the transmission may be formatted880 and delivered to a compliance server 850, prior to the abovetransmissions, or the like.

In some embodiments of the present invention, if a telephone of a useris associated with telephone carrier, e.g. LEC 970, that does not havean agreement with a billing intermediary (or the service provider of theherein described embodiments), the transmission service is modified. Invarious embodiments, the transmission may be reformatted to a documentand stored in a temporary memory location of transmission server 820.Next, instead of transmitting the document to the requested destination,transmission server may send a transmission to user 890 indicating thatthe transmission has not been sent to the desired destination.Additionally, the transmission may indicate alternative ways ofauthorizing the transmission, for example, user 890 calling-in a creditcard number, or the like.

In some embodiments of the present invention, user 890 may be notifiedof the failure of the transmission via a responsive fax to fax/scanner810, an e-mail sent to user 890 (identified by the FROM: field), or thelike. A time limit may be placed on the transmission, before thetransmission is deleted from the temporary memory location oftransmission server 820. For example, user 890 may have 24 hours, 3days, 1 week, or the like to provide payment information. If the timelimits expire without payment for the service, the transmission isdeleted.

In another embodiment, the user agrees to pay for the bill via the ISPwith whom they have an account. This data may be derived from the FROM:data field, illustrated in FIG. 10, or the like. For example, if FROM:field 440 specified: “CarolineCL@Earthlink.net,” the ISP “Earthlink” maybill the sender through her monthly account.

In various embodiments, to reduce the possibility of fraud, an e-mailmay be sent to the FROM: sender verifying that a transmission was sent,and that the ISP will be billed for the transmission. Embodiments mayalso require that the FROM: sender confirm a transmission via an e-mailmessage, before the transmission is provided to the TO: recipient. Instill another embodiment, the sender may pay for a transmission via anon-line payment system, such as PayPal, Visa, or other payment system.Then, once PayPal, Visa, or the like notifies transmission server 5 thatpayment was received, the transmission may be provided.

In various embodiments, additional filled-in data fields or options maybe provided on the template page to enable the user to enter billinginformation data, or third-party billing information mechanism. Forexample, in various embodiments, a user may enter a Federal Express, aUPS, a US Postal Service, a DHL, or the like account number, a PayPal orother electronic payment data, a Visa/MasterCard/Discover number orother credit card-related data, a prepaid telephone calling card accountinformation, a stored value card, a checking, savings, or debit accountnumber, a billing telephone number, and the like.

In some embodiments of the present invention, a“collect-on-delivery”-type (COD) payment mechanism may be implemented.In such cases, a sender may send an e-mail to a recipient, and therecipient is sent an e-mail notice from transmission server 5 that atransmission is waiting for them. To retrieve the transmission, therecipient may use any appropriate payment mechanisms, for examplediscussed above, such as direct billing, third-party billing, or thelike. Such embodiments are envisioned useful for business travelers, orthe like. As an example, a person may fax a copy of a document from onthe road to her home office. Later, when she arrives back home, sheopens the e-mail notice from transmission server 5, takes appropriateactions (e.g. provides account number and password) from a web-site, forexample, and then retrieves a copy of the transmission from the website.

As described earlier, some embodiments are based upon advertisersponsorship. Such embodiments may be based upon transmission data. Forexample, one embodiment detailed above included targeting geographicallyrelevant advertising based upon area code of the telephone coupled tothe transmission machine (e.g. fax machine, computer). Anotherembodiment is based upon targeting subject-matter relevant advertisingbased upon data optically character recognized from the transmission.

FIG. 13 illustrates a flow diagram according to various embodiments ofthe present invention. More specifically, FIG. 13 includes additionaldetail of steps 54 and 56 in FIG. 3B, and/or steps 116 and 124 in FIGS.8A and/or 8B.

Initially, the digitized representation of data (e.g. a document) isprocessed through an optical character recognition (OCR) engine, step300. In various embodiments, the data (e.g. text) obtained in this stepmay also be used for archiving purposes, document indexing purposes,text searching purposes, compliance purposes, or other purposepreviously described above. Accordingly, this step may or may notactually be part of steps 54, 56, or the like. In some embodiments, theOCR engine may include an automatic spell checker/spell correctionfunctionality. As a result, the recognized words in the document aremore likely to be correctly spelled. In various embodiments, the imageof the document may be modified to indicate where text captured by theOCR is not spelled correctly, where the OCR could not recognizecharacters, or the like, as a convenience to the receiver.

In various embodiments of the present invention, the recognized words inthe document are then passed through a relevance engine, step 310. It iscontemplated that the relevance engine may parse and process therecognized words in the document to semantically determine what thedocument is about, or the “relevance” of the document. In other words,the processing engine attempts to determine the subject matter of thedocument. As a first example, if the words “loan,” “title,” and“automobile” appear together frequently in a document, a relevanceengine may conclude the document is related to an automobile loan; as asecond example, if the words “loan,” “title,” and “property” appeartogether frequently in a document, a relevance engine may conclude thedocument is related to a mortgage; as a third example, if the words“loan,” “title,” and “property” do not appear together, but appearfrequently in a document, and the terms “farmer” and “fertilizer” appearfrequently, the relevance/advertisement engine/server may conclude thedocument is related to farming; and the like.

In various embodiments, recognized (key) words from a document may bepassed from the to a relevance engine to an advertisement server. Forexample, in some embodiments, the key words that are passed to therelevance/advertisement server, such as Google, Yahoo, e-Bay, MSN(Windows Live Search), A9, Lycos, Ask Jeeves (Ask), AOL, Fast Search,Baidu or the like, are simply a set of key words, or the like. Further,in return, what is returned from Google, or the like are one or morelinks, advertisements, messages, good/service listing, auction listing,search results, media, or the like, based upon the key words. Thus, ascan be imagined, these and other types of search results, in response tothe key words, can be provided in various embodiments of the presentinvention.

In some embodiments, the operator of the relevance/advertisement server(e.g. Google, or the like) does not know who the search is from. In suchembodiments, user privacy is thus maintained. In other embodiments, auser may voluntarily identify themselves to the relevance/advertisementengine. For example, the user may include tracking information that therelevance/advertisement engine can identify, such as a user name. Asexamples, when a user lists their specific e-mail address or user namein a FROM: CC: field, or the like, the user name/e-mail address, or thelike may be passed to the relevance engine such as A9.com, Google.com,Yahoo.com, or the like. In response, the relevance engine not onlyprovides one or more advertisements, but maintains the search resultsfor the benefit of the user, e.g. A9, Google Desktop, and the like.

In various embodiments of the present invention, any number of semanticparsing, relevance/advertisement engines, or the like may be used toperform the above analysis. This may include publicly available and asproprietary engines used by Yahoo!, Microsoft Search, Google and GoogleSearch, Excite, AskJeeves, and the like. Such engines are well-known tobe able to determine metrics, such as one or more key search terms, torepresent a document.

In some embodiments of the present invention, based upon the documentmetrics determined by the relevance engine, transmission server 5determines one or more appropriate advertisements to include in thedocument transmission, step 320. Continuing the examples above,advertisements about car insurance, car accessories, car wash coupons,or the like may be identified for a document using “title,” “loan,” and“automobile”; advertisements about moving companies, cleaning services,or the like may be identified for a document using “title, “loan,” and“mortgage”; and advertisements about weather, farm equipment, or thelike may be identified for a document using “farm,” and “fertilizer.”Accordingly, the advertisements selected are typically highly relevantto the subject matter of the documents.

In various embodiments of the present invention, one or moreadvertisements that are selected are sent to the sender of the document,step 330. In various embodiments, the advertisements may be presented asa return fax, as illustrated in FIG. 6A; the advertisements may bepresented in the body of the return e-mail message; the advertisementsmay be incorporated into the e-mail attachment; or the like. In variousembodiments, one or more user-clickable links, or hypertext links mayalso be included into an email. In various examples, the advertisementmay a service mark, a banner-type ad, a watermark, a sponsorship logo, aframe, or the like. In additional embodiments, these types ofadvertisements may also be sent to the recipient of the e-mail message.

In various embodiments, with the addition of click-through-typeadvertisements incorporated to the e-mail messages, revenue may beobtained. For example, revenue may be based upon number of impressions,number of click-throughs, number or amount of purchases resulting fromclick-throughs, and the like. Such revenue may be used to subsidize theservice, enhance revenues, or the like.

In various embodiments of the present invention, advertisements may alsobe sent to the recipients of the document, such as the FROM: and CC:recipients, step 340. In various embodiments, the advertisements may bepresented in a transmitted fax; the advertisements may be presented inthe e-mail message; the advertisements may be incorporated into thee-mail attachment; or the like. Similar to above, in variousembodiments, one or more user-clickable links, or hypertext links mayalso be included.

In some embodiments of the present invention, after the one or moreadvertisements have been provided, data is typically updated inadvertisement statistics server 98, step 350.

Two-Sided Source Document and Large Source Document Transmissions

Most fax machines and scanners have the capability to digitize documentsthat have printing only on one side of the paper, i.e. are one-sideddocuments. However, transmitting two-sided documents from such faxmachines or scanners has been a challenge. One method to transmittwo-sided documents has been to initially transmit only even or only oddpages in a first transmission, and then to transmit the remaining evenor odd pages in a second transmission.

One problem with this solution is that on the receiving end, thetransmissions, must be manually combined by the receiving party. Inother words, the receiving party is burdened with the task of trackingtwo separate transmissions and collating and interleaving the pages ofthe separate transmissions so that that pages of the source document arein the correct order. In an example, a first transmission may includeodd pages 1, 3, 5, 9, etc. and a second transmission may include evenpages 2, 4, 6, 8, etc. When the first and second transmissions arereceived, the recipient must manually assemble the two transmissions sothat the pages are in order: 1, 2, 3, 4, etc. This is extremely timeconsuming, especially for large transmissions. Further, because itrequires two or more separate transmissions, there is a greater chancethat one of the transmissions will be delayed, lost or mis-routed,especially in a busy office environment.

Another method for transmitting two-sided documents has been for thesender to first copy the two-sided document onto single-sided paper, andthen to fax the single-sided copy to the recipient.

A problem with this solution is that it requires the sender to make aseparate copy of the document. For example, the sender must manuallymake a single-sided copy of the two-sided pages on a copier, or thesender must use a copier that can copy two-sided documents ontosingle-sided paper with a document feeder. However, because documentfeeder copiers are expensive to own or to lease, they are typicallyfound only in office settings, and not at home offices. Accordingly,most users must manually make the single-sided copies. Other drawbacksinclude that making a separate single-sided copy of the document justfor transmission (e.g. faxing) purposes is extremely wasteful of paperresources and is wasteful of copier resources.

Currently, only a small percentage of fax machines and scanners have thecapability to digitize two-sided documents. The document feeders of suchfax machines and scanners are typically expensive, and accordingly, suchfeeders are mostly found in office settings, and not at home offices.

In some embodiments of the present invention, the inventors proposenovel methods for transmitting documents from two-sided source documentswithout the drawbacks described above.

In one embodiment, using the system described in the applicationincorporated by reference, a user opens a copy of the template page (a.pdf file) using Adobe Reader™ or Acrobat™ software or other appropriatesoftware (e.g. Word, PowerPoint). In response the template page, such asthat illustrated FIG. 11 is opened and displayed to the user.

In some embodiments of the present invention, the user has a two-sideddocument that they wish to transmit. To do so, the user first fills-inthe appropriate data in fields 410-490. Next, the user manually selectsoption 550 on fax template page 400, and when ready, prints out thefilled-in template page. This filled-in cover page is then placed as acover-sheet on the odd-numbered pages (e.g. the front sides of thetwo-sided document.) The assembled pages are then transmitted to thetransmission server as previously described above. In response, thetransmission server acknowledges receipt of this first transmission, asalso described above, with response fax, e-mail message, and the like.

In the present embodiments, while the template page is still open withinAdobe Reader™ software, the user then manually selects option 560 ontemplate page 400. By doing so, option 550 is automatically de-selected.In the various embodiments, the user then prints-out a copy of thefilled-in template page for the remaining even pages. This filled-incover page is then placed as a cover-sheet on the even-numbered pages(e.g. the back sides of the two-sided document.) The assembled pages arethen transmitted (e.g. faxed) to the transmission server as previouslydescribed above. In response, the transmission server acknowledgesreceipt of this second transmission, with a response fax, e-mailmessage, and the like.

In some embodiments of the present invention, the odd page transmissionmay be sent before or after the even page transmission. In suchembodiments, it is assumed that the odd page transmission includes thefirst page of the source document. In other embodiments, the firsttransmission sent is assumed to include the first page of the sourcedocument.

In other embodiments of the present invention, when either option 550 oroption 560 are checked, two separate cover-pages are automaticallygenerated for the user: one cover page for odd page transmissions, forexample, and one cover page for even page transmissions. In oneembodiment, one cover page has option 550 already checked, and the othercover page has option 560 already checked. In alternative embodiments,two substantially similar cover pages are printed-out, and the usermanually selects option 550 or option 560. In various embodiments, theuser manually prints out each cover page, whereas in other embodiments,the pair of cover pages are printed-out in response to a single userprint command.

In other embodiments, a single option may be provided instead of option550 and option 560, as a fill-in option within the fax template pagethat indicates that the faxed document will transmitted as two or moreseparate fax transmissions. As described above, two separate cover pagesmay be automatically generated for the user to print out and use ascover pages when the single option was selected. In various embodiments,most of the user entered data will be the same for both separate coverpages. However, to differentiate between the cover pages, any type ofvisible notice or indicators may be included on the cover page thatinstructs the sender which cover page to use for even pages and whichcover page for odd pages. For example, a “first” word may be stamped ina specific location on the first cover page, and a “second” word may bestamped in the same location, or different location on the second coverpage, or the like. In various embodiments, the first cover page and thesecond cover page may look very different.

In specific examples of the present invention, a fax server receives afax transmission, and determines that the transmission is a first halfof a transmission, in response to data on the first cover page. Invarious embodiments, the fax server “reads” that option 550 is selected;the fax server “reads” text, such as “first” on the cover page; noticesa mark at a pre-determined location; or the like. After receiving thefax transmission, the fax server typically will not automatically sendthe transmission to the recognized TO e-mail address (or destination),unless requested. In various embodiments, the fax server automaticallyindicates success of the first fax transmission to the FROM e-mailaddress. In various embodiments, the fax server stores the faxtransmission and awaits the second fax transmission.

Next, in such examples of the present invention, the fax serversubsequently receives a second fax transmission, and determines that thetransmission is the second half of a transmission. The fax server maydetermine this based upon identical filled-in data, such as the TO,FROM, SUBJECT fields, tracking number, and the like. The fax server mayalso determine this based upon data on the second cover page, such asrecognizing that option 560 is selected, recognizing text, such as“second” on the cover page, or the like. After receiving the second faxtransmission, the fax server typically does not automatically send thetransmission to the recognized TO e-mail address (or destination),unless requested, however may send acknowledgement to the FROM e-mailaddress. Time window limitations may also be used in various embodimentsso that two un-related documents from the same sender and to the samerecipients are not unintentionally mixed. An example time window may be24 hours, or the like.

In some embodiments of the present invention, once the transmissionserver determines that a pair of transmissions (e.g. even pagetransmission and odd page transmission) have been received, thetransmission server combines the transmissions into a singletransmission. In the example above, the fax server automaticallyinterleaves odd-pages of the document from the first transmission witheven-pages of the document from the second transmission. Accordingly,the assembled document includes a single (or both) cover page(s), thenpage one of the two-sided source document, page two of the two-sidedsource document, page three of the two-sided source document, and thelike.

The assembled document may then be saved in a desired file format invarious embodiments. For example, the assembled document can be storedas a single multi-page Adobe .pdf document, a single multi-page tiffdocument, or the like. In various embodiments, the assembled document issubsequently sent to the TO e-mail address (or destination), withappropriate copies to the carbon copy recipients, if any, and typicallyto the FROM e-mail address.

In other embodiments, other ways for combining data from multipletransmission are envisioned. For example, pages of multipletransmissions need not be fully interleaved or interleaved at all, andin another example the order for the multiple transmissions may bespecified. Such embodiments are useful when source documents may be verylong and unpractical to send as a single transmission. As an example, afirst transmission may include part 1 of a 500 page article, a secondtransmission may include part 3 of the article, and a third transmissionmay include part 2 of the article. In such embodiments, a user may beprompted for the number of transmissions for the source document, on thetemplate page. In response, these number of pages may automatically begenerated as cover sheets for the respective transmissions. Based uponthe data on the cover sheets, or the like, the receiving server (e.g.fax) can identify how the multi-part transmission should be reassembled.For example, the cover sheets indicate which transmission is to be thefirst, which is the second, and which is the third, in order. Othertypes of document collation are also envisioned by the inventors.

In another embodiment of the present invention, in addition toautomatically generated cover pages for multi-part transmissions,“chapter divider” pages may also be generated. Such chapter dividerpages may be used to indicate places within a single transmission wherethere are logical divisions. These logical divisions may be used, asabove, to indicate how multi-part transmissions, should be reconstructedin the fax server. As an example, a first transmission may includechapters 1, 3 and 4 of a book (using the chapter divider pages), and asecond transmission may include chapters 2, 5 and 6 of a book (alsousing the chapter divider pages.) In various embodiments, the user mayindicate via markings on the cover pages or the chapter divider pages,how the “chapters” of the transmissions are to be reassembled. Referringto such markings, in one example, the fax server combines thetransmissions and creates a single transmission with chapters 1-6 inorder. In other embodiments, many other ways to group pages betweenseparate transmissions are contemplated of the present invention.

According to the embodiments described in the above-mentionedapplication, the combined transmission may then be converted into one ormore data file in a data storage formats, such as Adobe .pdf-compatible,TIFF, JPEG, BMP, X-Docs, XML, .tiff, operating system-specific datastorage formats, operating system-independent data storage formats, orthe like.

Next, based upon the data “recognized” from the cover page, thetransmission server (e.g. fax server) determines transmissioninformation for the data file. In various embodiments, as describedabove, the transmission information may include an e-mail address for areceiver, a socket for a server on a computer network, a hyperlink forthe receiver to click upon to access the data file, a receiver accountnumber, or the like. In some embodiments of the present invention, basedupon the routing information, the transmission server also determines anappropriate network transfer protocol for the data file. In variousembodiments described above, the network transfer protocol is SMTP whenthe routing information is an e-mail address. In other embodiments,other types of network transfer protocols may be used including HTTPS,FTP, HTTP, or the like.

In some embodiments of the present invention, the server then sends thedata file out according to the routing information, using theappropriate network transfer protocol.

Tracking Data

As illustrated in FIG. 11, tracking number 580 may be provided on coverpages. Tracking number 580 may be generated at the time the userprints-out the filled-in template page, or when the template page isreceived by the transmission receiver/server, or the like. In variousembodiments, tracking number 580 may be reproduced on the filled-intemplate page, sent in a confirmation e-mail to the sender or receiver,or the like. In various embodiments, tracking number 580 may includevirtually any alphanumeric character, or the like.

In various embodiments, the tracking number may be based upon datafilled-in by the user, based upon user data, based upon the time anddate, media access controller (MAC) address, and the like. In variousembodiments, based upon such data, a hash, or other method forgenerating unique tracking numbers are contemplated.

In operation of specific embodiments, if a tracking number is assignedon the sender system, when the transmission server (e.g. fax server)receives the transmission (e.g. fax transmission), the transmissionserver performs optical character recognition to recognize the trackingnumber. In various embodiments, the tracking number may appear at aspecific predetermined location on the filled-in cover page, or anyother location. In the various embodiments, the tracking number is alsorecognized using OCR techniques. The tracking number is then associatedwith the entire facsimile transmission.

In some embodiments of the present invention, as the transmission serverprocesses the transmission, a log is generated which indicates thestatus of the transmission within the transmission server. For example,in various embodiments, the types of data that the transmission serverstores may include: number of pages currently received by thetransmission server (e.g. fax server), the status of the transmission(e.g. fax received?), the total number of pages received, the resolutionof the transmission (e.g. 400 dpi), the recognized TO, FROM, BCC, and CCe-mail addresses, if any, the recognized file names, the data fileformat (e.g. .pdf, .jpg, XML, etc.), the status of converting thetransmission into the data file format, the network transfer protocol(e.g. SMTP, HTTP, HTTPS, FTP, etc.), the status for sending the datafile (e.g. e-mail accepted by e-mail server at x time, e-mail bounced bye-mail server, e-mail reported as SPAM, etc.), whether a transmissionwas approved or denied, whether a user opened the transmission in thedata file format, whether a user requested the data file in a certifieddelivery system, and the like. Many other types of status andinformation can be logged in other embodiments of the present invention.In some embodiments, the type and/or amount of tracking data availableto a requester may be restricted.

In various embodiments, the sender of a transmission may requestinformation regarding the fax transmission via e-mail, IM, or the like,by submitting the tracking number to the transmission server. Inresponse, the requested status information is provided back to therequester. In other embodiments, at various stages in the transmissionprocess, status reports may automatically be provided to the sender, forexample, an e-mail with the information may be provided to the sender.

In other embodiments of the present invention, the tracking number isgenerated by the transmission server as it processes the transmission todetermine the transmission data. The generated tracking number is thenprovided back to the original sender of the fax. As above, the sendermay then request status information regarding the transmission to thetransmission server based upon the tracking number such as when ane-mail was sent to the recipient, or the like.

OCR Improvements

Optical character recognition (OCR) of human-readable data (e.g. handprinting), as well as machine-readable data (e.g. barcodes, MICR fonts)addresses, and the like have been successful for recognizing filled-indata for transmission cover sheets. Problems arise, however, when theOCR subsystem has difficulty recognizing the sender-entered data.Typical reasons why the OCR may have difficultly recognizing may includeimproperly printed characters, misaligned and/or rotated fax pages,noisy transmissions, and the like. Accordingly, the inventors haverecognized that additional ways to strengthen the recognition ofsender-entered data is desired.

In the example in FIG. 11, sender-entered data displayed and representedat more than one location of the cover page to improve the OCRrecognition process. More specifically, as illustrated in FIG. 11, Tofield 410, Carbon copy field 420, blind carbon copy field 430, fromfield 440, subject field 450, filename specification field 460, andcustom fields 470 and 480 are provided. Additionally, bar codes 590 and600 are also provided. In various embodiments, bar codes 590 and 600 mayinclude the identical data, or different data.

In some embodiments of the present invention, it is contemplated thattemplate 400 will be printed-out from within Adobe Reader™ software, anOffice productivity program (e.g. Word), or the like, after having thesefields filled-in by the sender. In such embodiments, fonts forhuman-readable characters in fields 410-480 may be output in a fontstyle more conducive to OCR techniques, such as MICR E-43B, CMC-7, andthe like.

FIG. 12 illustrates a example of another embodiment of the presentinvention. More specifically, a portion of a printed-out template page710 is illustrated. As can be seen, fields 720 and 730 may include thesame data, and are not aligned on the page. By positioning fields 720and 730 out of phase, vertical streaks 740, which are often present offax transmissions, tend not to obscure the same portion of fields 720and 730. Accordingly, the chance of recognizable data being transmittedfor both fields 720 and 730 are higher.

In some embodiments of the present invention, various types of syntaxchecking may be performed before the filled-in cover page isprinted-out. For example, for e-mail addresses, an appropriate top-leveldomain suffix (.com, .net, .gov, .biz, .org, etc.) may be checked andflagged if there is an error. As an example, if a user enters“apple@aol.con,” a message may be presented to the user, indicating thatthe top-level domain suffix does not exist.

Additionally, in other embodiments, syntax checking may be based uponthe domain name (e.g. aol.com, mit.edu) entered. In such embodiments,the validity of the domain name may be validated before the cover pageis printed-out. As an example, if the user enters a domain name such as“fotmail.com” the system may access the internet to perform a domainname look-up. In this example, if “fotmail.com” does not resolve to aserver, a message may be presented to the user, indicating that thedomain name does not exist. Alternatively, “fotmail.com” may beautomatically corrected to “hotmail.com.” In other embodiments,dictionaries, or other sources of common names may be the basis of otherautomatic corrections.

Other types of syntax checking may also be performed in otherembodiments, such as checking the e-mail addresses of the filled-infields to the sender's address book, or the like. In variousembodiments, the syntax checking functionality catches potential errorsbefore the document is transmitted to the transmission server.

In other embodiments of the present, the transmission server may performsyntax checking, described above, based upon the optical characterrecognition results, instead of the sending system. For example, if theOCR results read “aol.con,” or “mit.com” several options are available.In some embodiments, the transmission server may automatically determinea best guess based upon syntax. As an example, a fax server may change“aol.con” into “aol.com” and/or “mit.com” to “mit.edu.” In otherexamples, correction of data, such as e-mail addresses may be based onpart of prior history of the sender. For example, if a sender haspreviously sent many transmissions to “davidcl@mid.edu,” but for apresent transmission, the OCR system recognizes “qavidcl@mid.edu,” thetransmission server may automatically correct it to read“davidcl@mid.edu.” In various embodiments, the sender may be recognizedby a telephone number which the sender calls-into, based upon the FROMe-mail address, a telephone number of the sender's fax machine, and thelike. In other embodiments, automatic correction may be made based upone-mail addresses or like for an organization a sender is associatedwith, or the like.

In some embodiments, the transmission server may highlight the syntaxproblems to an operator at the transmission server. In response, theoperator may decide whether the proposed correction should be used ornot. In various embodiments, as discussed above, only the user-enteredaddress fields illustrated in FIG. 11 are displayed to an operator.Additionally, the remaining portions of the cover page, including notesfield 490 remains unavailable for operator review. Similarly, theoperator does not have access to any other part of the transmission, orany other page of the fax transmission. Using template pages withadditional OCR targets is believed to increase the accuracy of thetransmissions, without sacrificing the high level of security andconfidentiality already provided by embodiments of the presentinvention.

In other embodiments of the present invention, an “address” book basedupon prior transmissions by the sender may be maintained by thetransmission server, or the like. In cases where there is a syntaxerror, the transmission server may automatically determine if there is abest guess, and send the fax to that guess. In other embodiments, thetransmission server may alternatively output the syntax error to anoperator.

In still other embodiments, if there is a syntax error, the transmissionserver may automatically contact the sender via e-mail, instantmessenger, or the like, and indicate the syntax error, or the like. Insuch embodiments, the sender may be invited to provide the correcteddata by return communication. In some embodiments, the transmissionserver may automatically determine the corrected data from the senderand proceed based upon the corrected data. In other embodiments, anoperator may review the corrected data from the sender, and make thecorrection, if appropriate.

The above syntax checking and syntax error reporting and handling mayalso be uses to notify a sender of delivery failure errors for bouncede-mail messages, or the like.

Additional OCR Enhancements

In the embodiment illustrated in FIG. 11, barcodes 590 and 600 areincluded into fax template page 400. In various embodiments, barcodes590 and 600 provide OCR targets for the transmission server, in additionto fields 410-490. In the embodiments illustrated, fields 410-490 aretypically human-readable and machine-readable, however barcodes 590 and600 are typically only machine-readable.

In various embodiments, the printed characters in fields 410-490 arerecognized using optical character recognition of the text characters.In other embodiments, other language text characters may be supported byOCR techniques geared towards such languages. Additionally, barcodes 590and 600 are typically independently recognized using OCR of the barcodes. In some embodiments of the present invention, the recognized datafrom the three OCR targets must match to a high degree of confidencebefore the recognized data is used by the transmission server. In otherembodiments, candidate data recognized by two out of three OCR targetsmust substantially match before the recognized data is used by thetransmission server. In still other embodiments, if option 570 isselected, the OCR targets may be ignored, and fields 410-480 are used.

In some embodiments of the present invention, the data encoded inbarcodes 590 and 600 include only a subset of data in fields 410-480,for example, barcodes 590 and 600 may include only field 410 data andfield 440 data; only field 410 data, field 420 data, field 440 data;fields 410-450 data; or the like. In other embodiments, othercombinations or subsets of fields 410-480 are envisioned. In still otherembodiments, the same data may be encoded to barcodes 590 and 600, ordifferent data may be encoded to barcodes 590 and 600. For example, inone embodiment, both barcodes 590 and 600 include data from fields410-420, data from fields 410-450, or the like. As additional examples,barcode 590 includes data from field 440, but not data from field 430,whereas barcode 600 includes data from field 430 but not data from field440. In cases where data is unique to barcode 590 or 600, it iscontemplated that two out of two OCR engines (e.g. fields 410-480 OCR,and barcode OCR) return candidate data that must substantially agreeupon, otherwise an error is identified. Other types of examples can beenvisioned.

In still other embodiments of the present invention, barcodes 590 and600 may include check-sum, or hashed data based upon data from one ormore fields 410-490.

In operation, before the filled-in cover page is printed-out, thefilled-in data, and/or a hash of the filled-in data, or the like, isencoded into a bar-code format. The bar codes are then typically writteninto different orientations in barcode 590 and barcode 600, in FIG. 11.

In various embodiments of the present invention, the fonts appearing astext within fields 410-490, as well as the barcode fonts may be includedin a template .pdf file. To do so, in various embodiments, copyrights tothe included fonts must be obtained, and a flag must be set within thefont library embedded within the .pdf file that includes the copyrightstatus of the fonts.

Next, when the transmission server receives the filled-in cover page,separate OCR engines are used to recognize the filled-in data in fields410-490, and barcode 590 and 600. In one embodiment, if the recognizeddata from two or three of the OCR engines substantially match, thetransmission server processes the transmission using the recognizeddata. In another embodiment, if a hash of the data in fields 400-490substantially match the data encoded in barcode 590 and/or 600, thetransmission server processes the transmission using the recognizeddata. In case where the data do not match, the sender may be notified ofthe error and requested to correct the error, as described above. Also,an operator may be notified of the error and requested to intervene inthe transmission process.

Other Enhancements

FIG. 11 identified additional functionality that may be enabled by thetransmission server. In some embodiments of the present invention, whena sender selects field 500, the transmission server may use an opticalcharacter recognition engine to recognize the text in some/all of thepages of the received transmission. In one embodiment, the recognizedtext is combined with the images of the sent transmission in an Adobe.pdf file. In other embodiments, the recognized text may be provided asa .txt, .rtf, .doc file, or the like, along with the transmission to therecipient.

In some embodiments of the present invention, when a sender selectsfield 520, the transmission server may initiate an e-mail certificationprocess whereby certification of when an e-mail message, or the like isdelivered to the recipient, when the e-mail message is opened by therecipient, and the like. In such embodiments the original transmissionis typically stays resident upon the transmission server. Additionally,the recipient receives notification that a transmission has arrived forthe recipient in the form of an e-mail, page, cell-phone call, or thelike. In response, the recipient logs-into the transmission server witha password to retrieve the transmission. In such embodiments, when therecipient receives the transmission time is recorded.

In some embodiments of the present invention, when a sender selectsfield 530, the transmission server may provide an electronic post-markreceipt. In some embodiments of the present invention, it is envisionedthat an official US Postal Service electronic post-mark stamp may beassociated with fax transmissions. This provides several benefits,including officially certifiable electronic delivery of fax transmissiondata between parties, including certification of dates and delivery ofdata, and the like. In such embodiments, an inbound and/or outboundtransmissions may be hashed, and the hash then sent to a certifyingauthority. In various embodiments, hash algorithms may be used thatuniquely calculate a value based upon the transmission, such as MD(5) orthe like. In response to the hash, a US Postal service electronicpost-mark, or any other certifying authority mark, records the hash, aswell as the time and data into the certifying authority database. It isenvisioned that such certifications could be used to prove the sendingor delivery of the transmission.

FIG. 18 illustrates an embodiment of the present invention. Morespecifically, FIG. 18 illustrates the electronic post-mark receiptexample described above. In this example, via an transmissioninstruction page, a user may specify that the facsimile 1210 be“certified” as discussed above, via one or more user selectable options1200. The transmission server 1220 optically recognizes the e-mailaddress, as previously described, and the user-selected certificationoption. In response, a hashing algorithm, or the like is applied to thefacsimile 1210, and the hash is provided to a certification authority1230, or the like. In one example, certification authority 1230 providesa US Postal Service post mark to the hash, and the hash and the postmark are stored in a authentication database 1240. In variousembodiments, certification authority 1230 may be AuthentiDate Holding,Incorporated, Berkeley Heights, N.J. In the example shown, transmissionserver 1220 receives an electronic post mark (EPM) or the like fromcertification authority 1230. In various embodiments, the EPM may beprovided as an e-mail attachment 1260; and in other embodiments, an EPMmay be affixed as mark 1270 to one or more pages of email attachment1250.

Various embodiments of the present invention, may be used for electronicgreeting cards, or other image compositing service. In some embodiments,users may select a greeting card style via a web interface, or via atransmission instruction page. Additionally, the user may provide customhand-written greetings via the transmission instruction page, or anotherpart of a facsimile transmission. Examples are given below in FIGS. 18Aand B.

FIGS. 18A-B illustrate examples according to embodiments of the presentinvention. In the example in FIG. 18A, a transmission instruction page1300 may be provided at a number of locations, such as a greeting cardstore, a tourist event, or the like; available for download on acomputer; or the like. In this example, transmission instruction page1300 includes a location 1310 where the user can specify an e-mail orother electronic destination, graphical representations (e.g.thumbnails) 1320 of a number of greeting cards, or the like, along witha check box 1330 and/or user entry field 1340, that the user can enterthe identifier of the desired greeting card. Additionally, a blankregion 1350 may be provided where the user can enter their ownhand-written greeting. In this example, user hand writes the desirede-mail address and greeting in blank region 1350 and selects a greetingcard via check box 1330 or user entry field 1340, as mentioned above. Invarious embodiments, the transmission server optically recognizes thee-mail address in location 1310, as previously described, and theuser-selected greeting card. In response, as illustrated, an e-mail isgenerated and sent to the e-mail address. In various embodiments, theelectronic greeting card (static or animated) is combined with thehand-written message from blank region 1350, and attached to the e-mailas an e-mail attachment 1360.

In FIG. 18B, transmission instruction page 1400 may be provided at anumber of locations, such as a greeting card store, a tourist event, orthe like; available for download on a computer; or the like. In thisexample, transmission instruction page 1400 includes a location 1410where the user can specify a target e-mail addressor other electronicdestination, and a location 1420 for entry of identifier data. Invarious embodiments, before the above steps, the user logs into a website 1440 that includes a number of on-line electronic greeting cards.After selecting one of the greeting cards on the web site, the user mayassociate the identifier for the selected greeting card with the user'suser name, name, e-mail address; the target e-mail address, or the like.In other embodiments, the user may note the number of the desiredelectronic greeting card, or the like.

Returning to transmission instruction page 1400, in location 1420, theuser may provide the user's user name, name, number of the desiredelectronic greeting card, or the like. Additionally, a blank region 1430may be provided where the user can enter their own hand-writtengreeting. In this example, user hand writes the target e-mail addressand greeting in blank region 1430. In various embodiments, thetransmission server optically recognizes the target e-mail address inlocation 1410. In some embodiments, the transmission server determinesthe desired greeting card by processing the identifier data in location1420. For example, transmission server may look-up whether user haspreviously selected a greeting card at the web site, via user name,name; or has specified a greeting card identifier. In other embodiments,transmission server determines the desired greeting card by processingthe target e-mail address, the user's e-mail address or the like. Forexample, based upon the target e-mail address, transmission server maydetermine that when the user visited the web site, the user selected aspecific greeting card to be associated with the target e-mail address.In response, an e-mail is then generated and sent to the target e-mailaddress. In various embodiments, the electronic greeting card (static oranimated) is combined (composited) with the hand-written message fromblank region 1430, and attached to the e-mail as an e-mail attachment1450.

In still other embodiments of the present invention, the compositedelectronic greeting card may be placed on the web site for retrieval bya user associated with the target e-mail address.

In still some embodiments of the present invention, when a senderselects field 540, the transmission server may perform an additionalaction of affixing a digital watermark, or the like to the transmission.In various embodiments, the digital watermark may utilize electronicwatermarks onto .pdf, .tiff, .gif, .doc documents, or others. In otherembodiments, the digital watermark may include determining a unique hashor identifier for a transmission, and providing the hash or identifieras part of the fax transmission, or in a follow-up transmission, or thelike. Many other methods for watermarking are also contemplated.

In additional embodiments of the present invention, additionalfunctionality buttons for a template cover page may be displayed on thedisplay. For example, in one embodiment, a “problem” or “trouble” buttonis provided. It various embodiments, if a user selects the “problem”button, the user is coupled, for example, via a launched browser, to aservice page. In some embodiments, the version number of the templatepage, version number of the software (e.g. Adobe Reader), and the likemay be automatically sent, for remote problem diagnoses. In someembodiments, in response to the diagnoses, a patch may be provided tothe user, an updated template page may be provided to the user, the usermay be provided with a link to an upgrade page, and the like.

In other embodiments of the present invention, for upgrading purposes,updates to the template page are checked when the user opens thetemplate page. In cases where there is an update available, the user maybe presented with the option to update the template page and software.In various embodiments, appropriate telephone numbers and passwords maybe required from the user prior to an update being provided to the user.

In other embodiments of the present invention, when a sender sends afax, as part of the copy of the transmission the sender receives, anupdated template page may automatically be provided. Accordingly, usersare automatically updated when they use the transmission service.

In some embodiments of the present invention, when a sender selectsfield 510, the transmission server may perform an additional action ofsending the data to an archival system. In various embodiments, thearchival system may be associated with the transmission server, with thesender, with a third-party server, or the like. Typically, statusinformation associated with the transmission to the receiving party mayalso be sent to the archival system. In various embodiments, variousmethods for generating archival indexing terms may be used, includingbased upon send date, sender, receiver, and the like. In suchembodiments, the source document may be faxed, may be scanned, may beelectronically “printed” or the like to the transmission server. In someembodiments, transmissions from users may be from fax machines,scanners, multi-function machines, print-to-file computer output, andthe like. In such embodiments, fields on the transmission cover sheet,such as fields 450-490, may be used for the sender to identify keywordsuseful for indexing the transmission in the data archive.

In various embodiments, the cover page may be application-specific, andprovide drop-down boxes to the sender for fields 410-490, limiting thesenders' options. As examples, field 470 may be used to specify certaintypes of SEC filings, such as 10Q, 8K, or the like; field 410 may beused to specify between a limited number of data archives, such as “taxreturn form,” “trust request form,” and the like; field 480 may be usedto specify a scanning resolution, such as 200 dpi, 300 dpi, 72 dpi, andthe like.

Additionally, fields such as fields 410-440 may specify the appropriatedata archive. The data archive may include a storage area network, orother data store. In various embodiments, such embodiments, thetransmission server processes the transmission from the sender, andsends the transmission to the data archive.

As an example, a sender specifies on the transmission cover-page that adocument is to be sent to a tax data archive via field 410 or option510. Additionally, the sender also specifies the tax payer ID in field470, and tax form on field 450. As discussed above, option 500 may alsobe checked to make the contents searchable.

In one embodiment, once the transmission cover page has been filled-in,the sender prints-out the cover-page. Next, the sender assembles thecover page and the document, and then transmits (e.g. faxes) it to apre-specified telephone number. In various embodiments, the transmissionserver then receives the cover page, and then based upon OCR techniquesdetermines that the attached document is to be stored in the specifiedtax data archive. The attached document is also OCRed according tooption 500. The attached document may then be transformed into anotherformat, such as .pdf, .tiff, or the like. The document, or thetransformed document, and the OCRed text, and keywords are then providedto the tax data archive. In this example, the server associated with thedata archive receives the keywords, and stores the document, ortransformed document, along with the OCRed text, according to thekeywords.

In another embodiment, the transmission may be placed into a holdingserver, and only when the transmission is authorized, is thetransmission input into the data archive. For example, in oneembodiment, a compliance officer, or the like approves the transmission,before the transmission is stored in the data archive. In anotherexample, a sender reviews the keyword data, and other portions of thetransmission, before the sender authorizes the storage of thetransmission. In still other embodiments, when the sender reviews thetransmission, the sender enters the keywords, and then approves thetransmission.

In other embodiments of the present invention, the sender interface,described above may be web-based. For example, the user, via a webbrowser, or the like, connects to a web page which prompts her for datapossibly similar top fields 410-490 and options 500-570. The web pagemay be a web-based form. In some embodiments of the present invention,the user may type data into fields, or select entries, based upondrop-down boxes, as discussed above.

In various embodiments, based upon the form data, a template cover pageis prepared for the sender to print out. In some embodiments of thepresent invention, the cover page may be a .pdf, .gif, .tiff, .doc, orany other printable format, for transmission, as discussed above.Additionally, for multiple transmission documents, multiple cover pagesmay be provided, for transmission purposes, as discussed above.

In some embodiments of the present invention, the web server providingthe web form may provide a number of functions prior to providing theprintable cover page. As an example, the web server may automaticallyperform context checking of the sender entered data. For example, asdescribed above, entries with incorrect top level domain names, would beflagged as incorrect to the sender, and the cover page would not beprovided. As another example, the web server may store thesender-entered data or provide this data to the transmission server.Subsequently, when the sender send the transmission to the transmissionserver, the transmission server uses OCR to attempt to recognize theuser filled-in data. However, if there is an ambiguity in the OCRprocess, the transmission server cross-references the previouslysender-entered data, to determine the intended data. In otherembodiments, a special mark may be provided on the cover-page indicatingthat the transmission included data that was previously provide to thetransmission server (e.g. via the web form). In such examples, thetransmission server may perform sufficient OCRing of the cover page touniquely identify the sender-entered data previously stored. Next, thetransmission server may use the sender-entered data for transmissionpurposes.

Various embodiments, may include some, but not necessarily all of thefeatures describe above. For example, one embodiment may allow digitizeddocuments to be converted only to .pdf, or .tiff format and sent only toe-mail addresses. Other embodiments may allow digitized documents to beconverted into another file format, and be placed in a storage location.In such embodiments, an e-mail would be sent to a recipient includinginstructions to access the converted document at the storage location.Such embodiments allow tracking of receipt by the recipient. Anotherembodiment may redirect outbound digitized documents from specifiedsenders to a centralized queue for compliance purposes. In response, ifa compliance officer approves the transmission, the digitized documentmay again be converted into another file format, and then sent viae-mail to an e-mail address. Yet another embodiment may allow fordistributed archiving and indexing of digitized documents. For example,outbound transmissions are placed in a queue for indexing purposes. Inresponse, a sender manually provides indexing key words for thedigitized document. Once the index words are determined, the digitizeddocument and key words are provided to an archiving system.

In additional embodiments of the present invention, in addition to atransmission sent to the recipient including the digitized document, thetransmission may include a return fax coversheet. This option may bespecified by an option box on the coversheet, or the like. This faxcoversheet may be pre-filled-out with data from the “from” e-mailaddress and “to” e-mail address automatically switched. In this way, thereceiver can easily send a return transmission to the sender. Forexample, a loan officer may send documents for a applicant to sign, andthe digitized documents come to the applicant's e-mail box as a .pdfdocument. Along with the e-mail is a filled-in return fax coversheet. Inthis example, the applicant prints out and signs the documents, placesthe filled-in return fax coversheet on the signed documents, and faxesit to the number listed on the filled-in return fax coversheet. Thesigned document is then converted to a .pdf document, or the like, andsent to the loan officer's e-mail box. In various examples, the loanofficer can pay for the cost of both transmissions. In otherembodiments, a generic blank coversheet may be provided to therecipient. In other embodiments, the e-mail recipient may obtain anreturn fax e-mail coversheet in other ways described above. For example,the recipient may connect to a particular service provider web site viaa computer network link provided in the received e-mail. Similar to theabove, the link may be to a service provider home page, to a .pdf, orother similar standardized document, or the like. As above, the returnfax-to-e-mail (or electronic destination) service may be paid from theoriginal sender's account, a pay-per-service model, or the like.

Many changes or modifications are readily envisioned. In light of theabove disclosure, one of ordinary skill in the art would recognize thatmany variations may be implemented based upon the discussed embodiments.For example, in various embodiments described above, the e-mailattachment was converted into the Adobe .pdf file format, however, itshould be understood that in other embodiments, different “industrystandard” file formats currently developed, or developed in the futuremay also be used. These may also include “open” or “closed” (e.g.proprietary) document formats.

FIG. 14 is a simplified block diagram illustrating potential dataflowsdiscussed above, according to various embodiments of the presentinvention. Many other types of dataflows are also envisioned, asdiscussed above. FIG. 15 is a simplified block diagram illustrating anetwork architecture according to various embodiments of the presentinvention. Many other types of network architecture may be used in otherembodiments of the present invention.

Further embodiments can be envisioned to one of ordinary skill in theart after reading this disclosure. As an example, the inventors of thepresent invention believe that embodiments of the present invention mayeasily be applied to other forms of communication besides email, such asinstant messaging. Thus, embodiments may be developed that provideconverting an incoming facsimile to an instant message attachment. Insome embodiments, the service provider may use its own instant messagingclient, whereas in other embodiments, the sender of the fax may providetheir instant messaging client name and/or password, so that the instantmessage appears to be from the sender's messaging client. Embodimentsmay be applied to any instant messaging framework, such as AOL, Yahoo,MSN, or the like. As another example, the transmission may be sent toother destinations than an e-mail address, web post, or the like, forexample to a forum (e.g. Edmunds.com), a blog (e.g. Myspace.com,Tribe.net), a news site (e.g. Reuters, digg.com), or the like.

In other embodiments, combinations or sub-combinations of the abovedisclosed invention can be advantageously made. The embodiments aregrouped for ease of understanding. However it should be understood thatcombinations of blocks, additions of new blocks, re-arrangement ofblocks, and the like are contemplated in alternative embodiments of thepresent invention.

The specification and drawings are, accordingly, to be regarded in anillustrative rather than a restrictive sense. It will, however, beevident that various modifications and changes may be made thereuntowithout departing from the broader spirit and scope of the invention asset forth in the claims.

1. A method for a computer system for transmitting a facsimile to anelectronic destination address, comprises: receiving the facsimilecomprising an instruction page and a document, wherein the instructionpage includes an optical representation of the electronic destinationaddress and an optical representation of a user selection of one or moreoptions, and wherein the document is encoded in a first transmissionformat; determining the electronic destination address from the opticalrepresentation of the electronic destination address, wherein theelectronic destination address need not be known to the computer systembefore receiving the facsimile; determining the one or more selectedoptions in response to the optical representation of the user selectionof one or more options; determining a modified document in response tothe document and in response to the one or more selected options;encoding the modified representation of the document into a secondtransmission format; determining additional service provider data inresponse to the facsimile; and transmitting the additional serviceprovider data and the modified representation of the document encoded inthe second transmission format to the electronic destination address. 2.The method of claim 1 wherein the electronic destination address isselected from a group consisting of: an e-mail address, a storageaddress; and wherein the additional service provider data is selectedfrom a group consisting of: a service provider identifier, a servicesponsor identifier.
 3. The method of claim 2 wherein one selected optioncomprises a zoom option; and wherein determining the modified documentcomprises determining a zoomed version of a portion of at least one pagein the document in response to the zoom option.
 4. The method of claim 3wherein the zoomed version of at least a portion of the documentcomprises a zoomed page; and wherein determining the modified documentfurther comprises a step selected from a group consisting of: replacingthe at least one page in the document with the zoomed page in thedocument, appending the zoomed page to the document.
 5. The method ofclaim 4 wherein the zoom is selected from a group consisting of: anenlarging zoom, a reducing zoom.
 6. The method of claim 4 wherein thezoomed version of the portion of the document is associated with a zoomfactor; wherein the zoom factor is determined in response to a size ofthe portion of the document and in response to a page size of thedocument.
 7. The method of claim 4 wherein the portion of the documentcomprises at a portion of a page of the document; and wherein theportion of the page of the document is identified by a user-specifiedannotation associated with the page of the document.
 8. The method ofclaim 4 wherein the zoom comprises a reducing zoom; wherein the zoomedversion comprises a portion of a plurality of pages in the document; andwherein determining the modified document comprises a step selected froma group consisting of: replacing the plurality of pages in the documentwith the zoomed page in the document, appending the zoomed page to thedocument.
 9. The method of claim 8 wherein the zoom option comprises anN-up option.
 10. The method of claim 2 wherein one selected optioncomprises a crop option; and wherein determining the modified documentcomprises determining a cropped version of a portion of at least onepage in the document in response to the crop option.
 11. The method ofclaim 2 wherein one selected option comprises a rotate option; andwherein determining the modified document comprises determining arotated version of a portion of at least one page in the document inresponse to the rotate option.
 12. The method of claim 2 wherein oneselected option comprises a copier-type function option; and whereindetermining the modified document comprises determining a version of aportion of at least one page in the document in response to thecopier-type function option.
 13. The method of claim 12 wherein thecopier function is selected from a group consisting of: an enlargefunction, a reduce function, a rotate function, a crop function, a shiftfunction, a contrast modification function, a brightness modificationfunction, a multiple copy function.
 14. The method of claim 12 whereinthe copier function is selected from a group consisting of: a multiplecopy function, a margin adding function, a header or footer addingfunction, a border removing function, a reverse page output function.15. A method for a computer system for transmitting a facsimile to anelectronic destination address, comprises: receiving the facsimilecomprising a transmission cover page and a document; entering aplurality of text entries and at least a marked option on thetransmission cover page to form a filled-in transmission cover page,wherein the plurality of text entries includes the electronicdestination address; and sending a digitized transmission encoded in atransmission format to a transmission server, wherein the digitizedtransmission includes the filled-in transmission cover page and adocument; wherein a transmission is sent to the electronic destinationaddress and includes service provider data and a modified documentstored in a storage format; wherein the electronic destination addressis optically derived from the plurality of text entries on thetransmission cover page; wherein the modified document stored in thestorage format is determined in response to a user-selected option, andin response to the document in the transmission format; wherein theuser-selected option is optically derived from the marked option on thetransmission cover page; and wherein the transmission server need notknow the electronic destination address prior to receiving the digitizedtransmission.
 16. The method of claim 15 wherein the electronicdestination address is selected from a group consisting of: an e-mailaddress, a storage address; and wherein the service provider data isselected from a group consisting of: a service provider identifier, aservice sponsor identifier.
 17. The method of claim 16 wherein theuser-selected option comprises a zoom option; and wherein the modifieddocument comprises a zoomed version of a portion of the document inresponse to the zoom option.
 18. The method of claim 17 wherein thezoomed version of the portion of the document comprises a zoomed page;and wherein the modified document includes the zoomed page.
 19. Themethod of claim 17 wherein the zoom option is selected from a groupconsisting of: an enlarging zoom, a reducing zoom.
 20. The method ofclaim 17 wherein the zoomed version of the portion of the document isassociated with a zoom factor; wherein the zoom factor is determined inresponse to a size of the portion of the document and in response to apage size associated with the document.
 21. The method of claim 18wherein the portion of the document comprises a portion of a page of thedocument; wherein the portion of the page of the document is identifiedby a user-specified annotation associated with the page of the document;and wherein the portion of the document is optically derived from theuser-specified annotation.
 22. The method of claim 17 wherein the zoomcomprises a reducing zoom; wherein the zoomed version comprises aportion of a plurality of pages in the document.
 23. The method of claim22 wherein the zoom option comprises an N-up option.
 24. The method ofclaim 16 wherein the user-selected option comprises a crop option; andwherein the modified document comprises a cropped version of a portionof the document in response to the zoom option.
 25. The method of claim16 wherein the user-selected option comprises a rotate option; andwherein the modified document comprises a rotated version of a portionof at least one page in the document in response to the rotate option.26. The method of claim 16 wherein the user-selected option comprises acopier-type function option; and wherein the modified document comprisesa version of a portion of at least one page in the document in responseto the copier-type function option.
 27. The method of claim 26 whereinthe copier function is selected from a group consisting of: an enlargefunction, a reduce function, a rotate function, a crop function, a shiftfunction, a contrast modification function, a brightness modificationfunction, a multiple copy function.
 28. The method of claim 26 whereinthe copier function is selected from a group consisting of: a multiplecopy function, a margin adding function, a header or footer addingfunction, a border removing function, a reverse page output function.29. A computer system for transmitting a facsimile to an electronicdestination address, comprises: a receiving portion configured toreceive the facsimile comprising an instruction page and a document,wherein the instruction page includes an optical representation of theelectronic destination address and an optical representation of a userselection of one or more options, and wherein the document is encoded ina first transmission format; a detecting portion coupled to thereceiving portion, wherein the detecting portion is configured todetermine the electronic destination address from the opticalrepresentation of the electronic destination address, wherein theelectronic destination address need not be known to the computer systembefore receiving the facsimile; a determining portion coupled to thereceiving portion, wherein the determining portion is configured todetermine the one or more selected options in response to the opticalrepresentation of the user selection of one or more options; amodification portion coupled to the receiving portion and to thedetermining portion, wherein the modification portion is configure todetermine a modified document in response to the document and inresponse to the one or more selected options; an encoding portioncoupled to the modification portion, wherein the encoding portion isconfigured to encode the modified representation of the document into asecond transmission format; and a transmitter portion coupled to theencoding portion and to the detecting portion, wherein the transmitterportion is configured to transmit additional service provider data andthe modified document encoded in the second transmission format to theelectronic destination address.
 30. The computer system of claim 29wherein the electronic destination address is selected from a groupconsisting of: an e-mail address, a storage address; and wherein theadditional service provider data is selected from a group consisting of:a service provider identifier, a service sponsor identifier.
 31. Thecomputer system of claim 30 wherein one selected option comprises acopier-type function option; and wherein the modification portion isconfigured to determine a version of a portion of at least one page inthe document in response to the copier-type function option.
 32. Thecomputer system of claim 31 wherein the copier function is selected froma group consisting of: an enlarge function, a reduce function, a rotatefunction, a crop function, a shift function, a contrast modificationfunction, a brightness modification function, a multiple copy function.33. The computer system of claim 31 wherein the copier function isselected from a group consisting of: a multiple copy function, a marginadding function, a header or footer adding function, a border removingfunction, a reverse page output function.